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PREFACE  AND  ACKNOWLEDGMENT 


Steps  were  being  teOcen  to  obtain  facts  about  the  teO-ents 
of  our  youth  several  years  before  the  Russians  launched  their 
first  earth  satellite.  In  January  1957»  Dr.  John  C.  Flanageui 
prepared  and  submitted  the  first  proposal  for  Project  TALENT: 
An  Inventory  of  the  Aptitude  Resources  Available  for  the  Na¬ 
tion's  Needs  in  Professional,  Technical,  and  Public  Service 
Fields. 

A  conference  was  held  in  the  Washington  Office  of  the 
American  Institute  for  Research  on  February  27,  1957.  At 
this  meeting  the  proposal  was  presented  to  representatives 
of  government  agencies  and  professional  groups.  At  about  the 
same  time  the  proposal  was  discussed  with  representatives  of 
private  foundations  interested  in  educational  research.  The 
National  Science  Foundation  agreed  to  coordinate  plans  for 
government  participation  in  the  study. 

Dr.  Flanagan,  in  his  capacity  as  Professor  of  Psychology 
at  the  University  of  Pittsburgh  prepared  a  special  proposal 
to  the  Cooperative  Research  Program  of  the  United  States  Of¬ 
fice  of  Education  requesting  support  for  an  important  aspect 
of  the  study  dealing  with  personal  background  data.  The  Adr 
visory  Committee  for  the  Coopei'ative  Reseairch  Program  recom¬ 
mended  support  for  this  study  and  the  contract  was  completed 
in  June  1957*  Dr.  Robert  C.  Craig,  who  had  been  a  Research 


Scientist  on  the  staff  of  the  American  Institute  for  Research 


for  two  years  was  transferred  to  the  staff  of  the  University 
of  Pittsburgh  to  serve  as  Program  Director  for  the  study.  He 
began  work  full  time  on  Project  TALENT  on  July  1,  1957. 

On  October  10,  1957,  representatives  of  several  federal 
agencies  met  with  the  project  staff  at  the  offices  of  the  Na¬ 
tional  Science  Foundation  in  Washington  to  discuss  the  value 
of  the  coordinated  research  effort,  raise  technical  questions 
regarding  the  conduct  of  the  research  project,  and  to  make 
recommendations  for  further  financial  support  of  the  project. 

The  conferees  felt  the  project  would  have  Important  outcomes 
of  definite  value  to  both  national  and  individual,  objectives. 

They  recommended  support  for  a  thorough  planning  study. 

In  the  spring  of  1958,  the  National  Institute  of  Mental 
Health,  the  Office  of  Naval  Research,  and  the  National  Science 
Foundation  negotiated  supporting  contracts  with  the  University 
of  Pittsburgn  and  the  Americsui  Institute  for  Reseau’ch  to  sup¬ 
plement  the  funds  provided  by  the  United  States  Office  of  Edu¬ 
cation  to  carry  out  the  planning  phase  of  the  study.  In  Jime, 

Dr.  Robert  C.  Craig  resigned  to  accept  a  teaching  position. 

Dr.  John  T.  Dailey  replaced  him  as  Program  Director. 

The  plans  developed  by  the  Advisory  Panels  and  the  project 
staff  were  submitted  to  various  agencies  in  the  fall  of  1958 
with  a  request  for  support.  Dr.  Roy  M.  Hall,  Assistant  Com¬ 
missioner  for  Research  in  the  United  States  Office  of  Education, 
coordinated  government  planning.  In  accordsince  with  a  new  agree¬ 
ment  regarding  responsibility  for  fields  of  major  concern  in  the 

post-Sputnik  period,  this  coordination  had  been  shifted  from  the 
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national  Science  Foundation  to  the  Office  of  Education. 

In  a  meeting  with  Dr.  Roy  M.  Hall  at  his  office  in 
October  1958>  it  was  the  consensus  of  the  representatives 
of  the  interested  agencies  that  this  research  was  so  vital 
to  the  new  plans  and  programs  of  the  Office  of  Education 
that  it  seemed  most  appropriate  for  that  Office  to  provide 
major  support  for  the  program.  On  the  basis  of  these  recom¬ 
mendations  Dr.  Flanagan  prepared  a  proposal  requesting  the 
additional  support  needed  fir  the  first  five  years  of  the 
project. 

This  proposal  and  plans  for  the  study  were  reviewed  and 
recommended  for  approval  by  the  Advisory  Committee  of  the 
Cooperative  Research  Program  in  January  1958*  At  that  time 
the  Committee  Chairman  was  Dr.  ReQ.ph  W.  Tyler,  Center  for 
Advanced  Study  in  the  Behavioral  Sciences,  Palo  Alto, 
California. 

An  important  step  toward  the  realization  of  this 
research  program  was  taken  when  the  United  States  Commis¬ 
sioner  of  Education,  Lawrence  G.  Derthick,  approved  the 
proposal  that  the  Cooperative  Research  Program  supply  the 
major  portion  of  the  support  needed. 

These  funds  together  with  those  provided  by  the 
Rational  Institute  of  Mental  Health  and  the  Office  of 
Raval  Research  enabled  the  staff  to  proceed  in  May  1959 
with  the  tryout  of  experimental  forms  of  the  data  collection 
instruments. 

Since  the  inception  of  Project  TAIENT,  Dr.  John  C. 
Flanagan,  Professor  of  Psychology  at  the  University  of 
Pittsburg  and  Director  of  the  American  Institute  for 


for  Research,  has  been  the  Responsible  Investigator  for 
the  study.  Dr.  John  T.  Dailey  of  the  University  of  Pitts- 
burgjh  and  AIR  has  been  the  Program  Director  since  Dr. 

Craig  resigned  in  June  1958*  Other  members  of  the  steuff 
vho  have  taken  major  responsibility  for  various  aspects 
of  the  program  include:  Marion  F.  Shaycoft,  Supervisor 
for  Measurement  Studies;  William  A.  Gorham,  Supervisor 
for  Special  Studies;  David  B.  Orr,  Supervisor  for  School 
Characteristics  Studies;  Isadore  Goldberg,  Supervisor  for 
Manpower  and  Guidance  Studies;  and  Clinton  A.  Neyman,  Jr. , 
Supervisor  for  Services. 

Four  panels  of  the  nation's  leading  experts  were 
asked  to  work  with  the  staff  in  a  planning  study  for  the 
testing  phase.  They  have  been  active  in  all  phases  since. 
In  addition  to  experts  from  these  panels,  other  sampling 
experts  worked  with  in  determining  the  sampling  procedures 
were:  Morris  Hansen  of  the  B\xreau  of  the  Census,  Frederick 
Stephan  of  Princeton  University,  William  Cochran  of 
Harvard  University,  and  Phillip  J.  Rulon  of  the  Heorvard 
Graduate  School  of  Education.  The  overall  Charlman  of 
the  Advisory  Peuiels  dinring  the  planning  phase  was  Dr. 

John  H.  Fischer,  then  Superintendent  of  the  Bal- 
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timore  Public  Schools,  The  present  Chairman  is  Dr.  Kenneth 
E.  Oberholtzer,  Superintendent  of  the  Denver  Public  Schools. 

The  following  is  a  list  of  the  Advisory  Panels  and  their 
members: 

Guidance  and  Counseling  Panel 

Chairman,  Edward  Landy,  Director,  Division  of  Counseling 
Services,  Newton  (Massachusetts)  Public  Schools 

Ralph  F.  Berdie,  Director,  Student  Counseling  Bureau, 
University  of  Minnesota 

Bruce  E,  Shear,  Chief,  Bureau  of  Guidance,  New  York  State 
Education  Department 

John  M.  Stalnaker,  President,  National  Merit  Scholarship 
Corporation 

David  V.  Tiedeman,  Associate  Professor  of  Education, 

Harvard  University 

Arthur  E.  Traxler,  Executive  Director,  Educational 
Records  Bureau 

Leona  E.  Tyler,  Professor  of  Psychology,  University 
of  Oregon 

Educational  Research  Panel 


Chairman,  Robert  J.  Keller,  Director,  University  High 
School,  University  of  Minnesota 
Reverend  O'Neil  C.  D' Amour,  Assistant  to  the  Executive 
Secretary,  National  Catholic  Education  Association 
Paul  L.  Banfield,  Headmaster,  Landon  School  (Maryland) 
Warren  G.  Findley,  Assistant  Superintendent  for  Pupil 
Personnel  Services,  Atlanta  Public  Schools 
Earl  J.  McGrath,  Professor  of  Education,  Teachers 
College,  Columbia  University 
Paul  T,  Rankin,  Assistant  Superintendent  of  Schools, 
Detroit  Public  Schools 

James  W.  Reynolds,  Professor  of  Education,  University 
of  Texas 

J.  Wayne  Wrightstone,  Director,  Bureau  of  Educational 
Research,  New  York  City  Board  of  Education 

Testing  Problems  Panel 

Chairman,  Robert  L.  Thorndike,  Head,  Department  of 
Psychological  Foundations  and  Services,  Teachers 
College,  Columbia  University 
Henry  Chauncey,  President,  Educational  Testing  Service 
/  Wayne  H.  Holtzman,  Associate  Director,  Hogg  Foundation, 

University  of  Texas 

A.  Paul  Horst,  Professor  of  Psychology,  University 
of  Washington 

Lloyd  G.  Humphreys,  Chairman,  Department  of  Psychology, 
University  of  Illinois 

E.  Lowell  Kelly,  Director,  Bureau  of  Psychological 
Services,  University  of  Michigan 
Joseph  Zubin,  Principal  Research  Scientist,  Biometrics  Re¬ 
search  Unit,  New  York  State  Department  of  Mental  Hygiene 
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Manpower  and  Sociology  Panel 


Chairman,  Samuel  A.  Stouffer,  Director,  Laboratory  of 
Social  Relations,  Har/ard  University 
E.  Franklin  Frazier,  Head,  Department  of  Sociology, 

Howard  University 

Seymour  E.  Harris,  Chairman,  Department  of  Economics, 
Harvard  University 

Donald  G.  Marquis,  Massachusetts  Institute  of  Technology 
Irving  D.  Lorge,  Executive  Officer,  Institute  of 
Psychological  Research,  Teachers  College, 

Columbia  University 

C.  Joseph  Nuesse,  Dean,  School  of  Social  Science, 

Catholic  University  of  America 
Fred  L.  Strodtbeck,  Associate  Professor  of  Sociology, 
University  of  Chicago 

An  Advisory  Council  of  the  presidents  and  executive 
secretaries  of  the  professional  and  scientific  associations 
interested  in  the  project  were  asked  to  give  advice  and  coun¬ 
sel  and  to  review  the  suggestions  and  plans  of  the  four  panels. 
The  Advisory  Covincil  in  1959-60  included: 

Martin  Essex,  President,  American  Association  of 
School  Administrators 

George  E.  Watson,  President,  Council  of  Chief  State 
School  Officers 

Edgar  Fuller,  Executive  Secretary,  Council  of  Chief 
State  School  Officers 

Duggld  S.  Arbuckle,  President,  American  Personnel 
a^d  Guidance  Association 

Arthur  A.  Hitchcock,  Executive  Secretary,  Americnr 
Personnel  and  Guidsuace  Association 

Paul  E.  Klopsteg,  President,  Americeui  Assoclatiou 
for  the  Advancement  of  Science 

Dael  Wolfle,  Administrative  Secretary,  American 
Association  for  the  Advancement  of  Science 

Donald  0.  Hebb,  President,  American  Psychological 
Association 

John  G.  Darley,  Executive  Secretary,  American 
Psychological  Association 

Robert  E.  Willis,  President,  National  School  Boards 
Association 

W.  A.  Shannon,  Executive  Director,  National  School 
Boards  Association 

Cliff  Robinson,  President,  National  Association  of 
Secondary  School  Principals 

The  Rt.  Rev.  Hsgr.  T.  Leo  Keaveny,  President, 

Secondary  School  Department,  National  Catholic 
Education  Association 

The  Rt.  Rev.  Msgr.  F.  Q.  Hochwald,  Executive  Secretary 
National  Catholic  Education  Association 

*  Dr.  Stouffer  was  a  most  effective  chairman  until  his  untimely 
death  in  the  summer  of  i960. 
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Many  profesBional  people  outside  the  staff  of  Project  TALBIT 
gsTe  most  generously  of  their  time  and  efforts.  Most  outstanding 
were  the  90  Regional  Coordinators  who  were  the  field  represents- 
tires  for  the  project.  Much  of  the  sueoess  Project  TAIJBIT  has  en¬ 
joyed  can  be  attributed  to  their  efforts  in  arranging  for  the  eeep- 
eration  of  the  schools  In  adainlsterlng  the  tests.  They  also 
serred  as  adrlsors  on  adainlstratlTe  procedures  for  the  testing 
phase  of  the  study. 

Regional  Coordinators  for  the  project  are, listed  by  states:, 
Alabama 

Paul  R.  Qlvens,  Birmingham-Southern  College 

Herbert  Kber,  Birmingham 
Alaska* 

Ariz»nit  and  Nevada 

Richard  E.  Behutz,  Arizona  State  University «  Tempe 
Arkansas 

Carter  Short,  University  of  Arkansas,  Fayetteville 

Hardy  C.  Wileozon,  University  of  Arkansas,  Fayetteville 
California 

Alez  D.  Alois,  Loyola  University  of  Los  Angeles 

John  Caffrey,  Director  of  Research,  Psdo  Alto 
Unified  School  District 

Frederick  J*  McDonald,  Stanford  University 
Colorado 

Anthony  C.  Tucker,  University  of  Denver 
Connecticut 

Joseph  Raymond  Qerberlch,  University  of  Connecticut,  Storrs^ 
Delaware 

Arthur  R.  DeLong,  University  of  Delaware,  Newark 
District  of  Columbia 

William  A.  Qorham,  University  of  Pittsburgh 
Florida 

Edward  Caldwell,  Board  of  Public  Instruction, 

Manatee  County,  Bradenton 

John  V.  McQultty,  University  of  Florida,  Oalnesville 
Georgia 

Cameron  Fincher,  Georgia  State  College 
for  Business  Administration,  Atlanta 

G.  H.  Fort,  Board  of  Education,  Atlanta 

Richard  H.  Kickllghter,  University  of  Florida,  Gainesville 

R.  T.  Osborne,  University  of  Georgia,  Athens 
Hawaii* 

Idaho 

Slwyn  OeLaurler,  State  Guidance  Supervisor, 

Department  of  Education,  Boise 
Illinois 

N.  L.  Gage,  University  of  Illinois,  Champaign 

Lyman  J.  Smith,  Illinois  State  Scholarship  Conmlssion,Deerfield 
Indiana 

N,  A.  Fattu,  Indiana  University,  Bloomington 

H.  H.  Remmers,  Purdue  University,  Lal'ayettu 

*  Hemdled  by  Central  Staff  vii 


Iowa 

Arthur  Mittman,  University  of  Iowa,  Iowa  City 
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CHAPTER  I 

RATIONALE  FOR  THE  STUDY 

Are  ve  making  the  most  of  the  talents  of  our  youth?  Will 
our  children  Identify,  develop  euad  use  their  aptitudes  and 
abilities?  Experts  disagree  on  the  nature  and  extent  of 
available  talents.  They  disagree  on  how  our  schools  should 
help  each  student  to  develop  his  talents.  And  they  further 
disagree  on  how  ihe  individual  and  the  nation  can  best  use  the 
talents  developed. 

Would  raising  the  quality  of  our  schools  in  underprivi¬ 
leged  areas  double  or  queidruple  our  supply  of  top-level  scien¬ 
tists,  writers,  or  statesmen?  The  author  of  "Wasted  Talent" 
in  the  report.  The  Nation* s  Children  published  for  the  i960 
White  House  Conference  on  Children  and  Youth  cites  studies 
which  he  believes  demonstrate  that  superior  education  is  di¬ 
rectly  responsible  for  producing  high-level  talent.  This 
view  is  supported  by  the  fact  that  in  the  Science  Tedent 
Search  in  lAilch  winners  are  selected  solely  on  a  national  ba¬ 
sis  without  set  quotas  from  individual  states,  kO  percent  of 
the  winners  come  from  New  York  State  which  has  less  than  tea 
percent  of  the  eligible  population.  New  York  State’s  expenditures 
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for  education  are  among  the  highest  in  the  country.  It  is 
also  common  Imovledge  that  certain  teachers  and  certain  de¬ 
partments  in  other  parts  of  the  country  produce  a  high  pro¬ 
portion  of  the  winners  in  national  contests  of  creative  writing, 
debating,  drama,  and  art. 

Many  educational  experts  disagree  with  the  view  that  only 
a  fraction  of  the  potential  talents  of  our  young  people  are 
developed.  Articles  on  the  value  of  scholarship  aid  have  usual¬ 
ly  suggested  that  there  are  a  relatively  small  fraction  of 
the  very  able  students  who  are  unable  to  obtain  college  train¬ 
ing.  A  report  on  college  scholarships  and  the  hi^er  educa¬ 
tion  of  gifted  students  indicates  that  most  of  the  several 
thousand  students  in  the  study  obtained  scholarships  and  went  on 
to  college .  Approximately  2000  of  the  remaining  candidates 
had  very  high  scores  but  did  not  win  scholarship  support  of 
any  kind.  Nearly  ninety  percent  of  these  students  went  on 
to  college  in  spite  of  their  failure  to  obtain  fineuicial  sup¬ 
port.  It  is  clear  that  when  we  consider  only  the  top  one- 
half  of  one  percent  of  the  nation's  hi^  school  graduates, 
nearly  all  of  them  go  to  college.  This  would  indicate  that 
only  a  very  small  fraction  of  the  available  supply  of  high- 
level  ted.ent  is  currently  being  wasted. 

Experts  also  disagree  on  the  basic  nature  of  human  tal¬ 
ents.  John  B.  Watson,  the  founder  of  behavioristic  psychology, 
stated  that  given  a  normal  healthy  infant  he  could  by  varying 
the  environment  build  into  that  child  any  desired  pattern  of 
talents.  Few  psychologists  in  America  still  hold  this  view 
today.  In  Russia,  however,  there  is  still  strong  support 
for  this  theory. 

If  children  do  differ  in  their  ability  to  learn,  is  this 
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ability  a  single  dlaenslon  of  mind  as  Implied  by  the  Intel¬ 
ligence  Quotient  from  the  Stanford-Blnet  and  other  tests  of 
general  Intelligence >  or  are  children's  mental  abilities 
best  described  in  terms  of  several  dimensions  or  aptitudes? 
During  World  War  II  It  vas  clearly  demonstrated  that  the 
pattern  of  aptitudes  that  made  a  good  pilot  vas  different 
from  that  vhlch  made  a  good  navigator.  A  series  of  twenty 
aptitude  tests  vas  given  to  thousands  of  cadets  before  they 
started  training.  A  follow-up  study  of  their  later  success 
In  pilot  or  navigator  training  Indicated  fdilch  combination  of 
high  test  scores  identified  the  superior  pilot  dr  navigator. 


If  hinnan  talents  include  a  vsuriety  of  patterns  and  we 


identified  by  tests  of  general  Intelligence,  how  can  we  ident¬ 
ify  and  develop  these  patterns?  How  marjy  important  patterns 
of  aptitude  are  there?  How  can  we  identify  the  patterns,  which 
If  developed,  will  make  a  superior  surgeon,  high  school 
English  teacher,  electronics  engineer,  or  auto  mechanic? 

The  identification  of  a  student's  unique  pattern  of 
aptitudes  Is  the  first  ImportEuat  step.  If  he  Is  to  realize 
his  highest  potential,  his  tsdents  must  be  developed.  What 
types  of  learning  experience  will  be  most  effective?  Many 
controversies  exist  regarding  what  constitutes  the  best  second- 
ary  education  program.  In  the  past  few  years  there  has  been 
a  demand  from  colleges  and  universities  for  Increased  empha¬ 
sis  on  the  basic  skills  of  reading  and  writing,  and  more  for¬ 
med.  trednlng  In  mathematics  and  science.  Many  scholars,  es¬ 
pecially  those  representing  the  European  point  of  view,  say 
that  in  America's  effort  to  achieve  seconda^  education  for 
all,  we  have  sacrificed  not  only  scholarship  standards,  but 


1-4 


the  basic  fundamenteJ.  curriculum  as  well.  The  critics  say 
that  courses  in  life  adjustment,  swimming, and  driver  training 
are  inade<iuate  substitutes  for  much  needed  advsuiced  training 
in  the  fields  of  mathematics  and  physics  essentlsQ.  to  develop¬ 
ing  the  talents  of  our  able  youth. 

Other  experts  on  secondary  education  eurgue  that  the  schools 
have  a  strong  responsibility  to  train  our  yoiuig  people  for 
citizenship  and  to  broaden  the  vorlzons  of  the  many  students 
who  will  not  go  on  to  colleges  and  universities. 

There  is  pressure  for  larger  secondary  schools  in  tdilch 
a  greater  variety  of  courses  and  more  homogeneous  grouping  of 
talents  is  possible.  Opponents  of  this  view  eurgue  for  more 
personal  attention  in  smaller  schools  and  greater  opportunities 
for  the  development  of  leadership  in  both  curricular  and  extra¬ 
curricular  activities. 

Reinforcing  the  view  that  poorly  qualified  teachers  are 
instructing  our  students  in  the  wrong  courses  in  our  secondary 
schools  are  the  efforts  by  national  subject  matter  specialists 
to  revise  drastically  the  whole  course  of  instruction  in  many 
fields  of  secondsury  education,  including  science,  mathematics, 
and  the  foreign  leuiguages. 

The  many  proposers  and  coilhtqr  proposstls  for  changing 
o\ar  school  programs  offered  by  committees,  commissions  and  in- 
dividusil  critics  all  appear  vulnerable  on  one  important  criti¬ 
cism.  They  represent  opinions  and  lach  a  sound  factual  basis. 

The  final,  and  perhaps  most  important  aspect  of  the  pro¬ 
cess  of  Increasing  the  realization  of  the  IndividusLL's  potential 
is  the  use  he  makes  of  his  unique  patterns  of  aptltiides  and 
abilities  after  they  have  been  developed.  The  problems  here 
are  centered  around  such  topics  as  motivation,  creativity  and 
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productivity. 

In  a  recent  study  of  the  motivation  to  work  the  investi¬ 
gators  report  that  factors  such  as  a  good  salary^  a  good  su¬ 
pervisor,  good  vorklng  conditions,  congenieLL  fellow  workers, 
and  a  good  working  environment  are  sufficient  to  prevent  dis¬ 
satisfaction  with  work,  but  they  do  not  provide  the  positive 
incentives  necessary  for  strong  and  persistent  efforts.  It 
is  proposed  that  this  positive  type  of  motivation  to  work  is 
provided  when  the  individual  realizes  that  his  efforts  make 
a  definite  contribution  toward  achieving  a  goal  which  he  rec¬ 
ognizes  to  be  important.  Thus,  growth  and  accomplishment 
become  the  principal,  motivators.  This  concept  of  self-reali¬ 
zation  is  in  opposition  to  the  popular  view  that  motivation 
and  morale  are  primarily  a  function  of  eua  appreciative  super¬ 
visor  and  a  pleasant  working  environment. 

The  factors  influencing  creativity  have  also  been  the 
subject  of  much  recent  speculation  among  those  concerned  with 
the  problem  of  helping  individuals  to  medce  best  use  of  their 
talents.  Some  eurgue  that  creativity  is  primarily  a  product 
of  a  favorable  environment.  Others  have  conducted  studies 
to  show  that  certain  types  of  creativity  can  be  substantially 
Improved  through  special  training  courses.  There  is  also  a 
limited  amount  of  evidedce  suggesting  that  creativity  results 
from  a  special  aptitude  for  seeing  the  application  of  a 
familiar  idea  in  an  vtnusucLL  or  novel  situation. 

There  haus  been  much  concern  regarding  the  productivity 
of  both  lndlvldvieQ.8  auid  groups.  Everyone  is  familiar  with 
examples  of  the  highly  talented  individual  wasting  his  talents 
even  after  they  have  been  fully  developed,  because  he  does 
not  make  best  use  of  his  aptitudes  and  abilities.  We  sure 
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also  familiar  vith  persons  vho>  In  spite  of  rather  mediocre 
abilities^  have  forged  ahead  to  make  significant  contributions. 

These  Issues  regarding  the  talents  of  Aoerlceui  youth— 
their  Identification,  development,  and  use — provided  the  basic 
framework  for  the  design  of  Project  Talent.  The  ensuing 
chapters  outline  the  steps  In  planning  and  carrying  out  the 
initial  phase  of  a  project  to  provide  a  sound  factual  basis 
to  assist  parents,  teachers  and  school  administrators  ih^halp- 
ing  each  individual  to  resO-ize  his  greatest  potential. 
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CHAPTER  II 

MCKGROUND  AMD  PtiANMIMG 

The  year  was  1959-  In  8-  hotel  conference  room  in  the 
nation's  capital,  a  group  of  men  sat  quietly  naklng  plans 
for  1984.  While  the  headlines  shouted  threats  of  atomic 
war,  atmospheric  pollution,  social  disintegration,  and  Big 
Brother,  they  were  calmly  perfecting  plans  for  a  25 -year 
study  of  American  youth  and  their  schools.  About  410,000 
high  school  students  emd  their  schools  were  to  be  studied 
Intensively  over  a  25 -year  period. 

This  was  to  be  America's  first  census  of  the  aptitudes, 
achievements?  and  talent  potentials  of  its  youth.  The 
students  were  to  be  followed  up  in  one  year  after  graduation 
from  high  school  and  then  five  years,  ten  years,  and  twenty 
years  after,  in  order  to  congaire  their  test  performances 
uid  the  school's  educational  and  guidance  programs  wltA  what 
the  students  did  as  adults. 

The  year  was  1939—20  years  before.  A  similur  grotq> 
of  men  sat  around  another  conference  table  in  Mew  York  City 
discussing  a  proposal  for  a  similar  study.  Dr.  John  C. 


Flanagem  was  presenting  a  proposal  to  the  C^'inmlttee  on 
Measuremeat  euid  Guidance  of  the  ilmerlcan  Council  on  Edu¬ 
cation  to  draw  a  national  sample  for  inventorying  the  apti¬ 
tudes  and  achievements  of  American  youth.  While  all  agreed 
on  the  vital  in^jortance  of  such  a  project,  it  was  reluc¬ 
tantly  concluded  after  much  discussion  that  the  project 
would  not  be  feasible  at  that  time  because  ,of  the  relatively 
primitive  facilities  then  existing  for  scoring  tests  and 
processing  large  masses  of  data. 

Within  a  few  months.  World  War  II  erupted.  During 
World  War  II  Dr.  Flanageui  mobilized  a  large  group  of 
psychologists  in  a  research  program  supporting  our  U.S. 

Air  Corps.  This  group  in  a  short  period  of  three  or  four 
years  made  great  strides  in  the  techniques  of  mass  testing 
programs  and  were  responsible  for  a  substantial,  improvement 
in  the  accuracy  of  selecting  pilots  and  other  aircrew  mem¬ 
bers  for  training.  The  other  Armed  Services  also  had  such 
programs  and  made  much  progress  in  the  state  of  the  art  of 
testing  and  handling  of  mass  data. 

Soon  after  World  War  II,  several  members  of  the  Air 
Corps  group  began  actively  to  work  toward  a  national  cen¬ 
sus  of  aptitudes  and  achievements.  Dr.  Robert  L.  Thorndike 
of  Columbia  University  was  assigned  responsibility  for 
research  toward  determining  the  feasibility  of  such  a 
census  and  the  best  way  of  doing  it.  Later,  in  1956,  a 
conference  on  Air  Force  problems  and  test  standardization 
was  held  under  the  chairmanship  of  Dr.  Lloyd  G.  HuBqphreys. 
This  group  outlined  tentative  specifications  for  a  recom¬ 
mended  aptitude  census. 

The  work  during  World  War  II  emphasized  the  importsmce 


of  follow-up  studies  to  prove  that  the  tests  used  really 
work  in  the  sense  that  scores  on  selected  tests  are  actually 
demonstrated  to  predict  future  important  performance.  This 
and  similar  work  improved  the  effectiveness  of  follow-up 
techniques  and  greatly  increased  the  general  level  of 
"know-how"  in  this  field.  An  excellent  example  of  this  is 
Thorndike's  follow-up  study  of  10,000  men  who  had  taken  the 
battery  of  20  aircrew  aptitude  tests  during  World  War  II. 

He  compared  their  scores  with  data  regarding  occupational 
field  entered  and  salary  level  achieved  twelve  years  later. 
Planning 

As  a  result  of  a  series  of  meetings  during  195T> 
several  government  agencies  agreed  to  support  a  planning 
study  to  determine  the  Talent  Census  needs  from  a  national 
point  of  view  and  to  prepare  a  specific  plan  for  the  pro¬ 
gram.  This  planning  study  was  conducted  jointly  by  the 
American  Institute  for  Research  and  the  University  of  Pitts¬ 
burgh,  with  support  from  the  National  Institute  of  Mental 
Health,  the  National  Science  Foundation,  the  Office  of 
Naval  Research,  and  the  Cooperative  Research  Program  of 
the  U.S.  Office  of  Education. 

During  this  planning  phase,  the  new  Impetus  given 
educational  and  scientific  studies  following  the  successful 
satellite  experiments  of  the  USSR  resulted  in  a  definition 
of  euTeas  of  responsibility  in  these  fields  among  the  federal 
agencies.  At  this  time  support  of  testing  programs  at  the 
secondary  school  level  was  allocated  to  the  U.S.  Office  of 
Education.  The  National  Science  Fovindatlon  therefore  suggested, 
with  the  concurrence  of  the  Assistant  Commissioner  of  Education 
for  Research,  that  responsibility  for  planning  and  coordinating 


this  program  be  transferred  to  the  U.S.  Office  of  Education. 

As  a  result  of  this  and  subsequent  decisions^  "Project 
Talent"  Is  financed  for  the  most  part  by  funds  from  the 
U.S.  Office  of  Education. 

Plane  developed  through  the  Panels  vere  reviewed  by  an 
Advisory  Council  composed  principally  of  Presidents  and 
Executive  Secretaxles  of  the  professloneJ.  associations  most 
Interested  In  the  findings  from  this  study.  (See  preface 
for  details  about  Panels  and  Advisory  Council.) 

Regional  Coordinators  (peurb-tlme  Project  field  repre¬ 
sentatives)  administered  the  pTOgram  locally.  They  arranged 
for  cooperation  of  schools,  and  served  as  advisors  on 
procediires.  These  local  offlclGQ.s,  familiar  with  the  edu¬ 
cational  needs  and  resources  of  the  local  communities,  vere 
the  key  representatives  In  the  Important  testing  phase. 

All  results  from  the  survey  and  the  studies  which 
follow  will  be  published  and  will  be  available  to  educators 
and  reseerch  specialists.  Prior  to  publication,  these  studies 
will  be  reviewed  by  the  Panels  of  experts  and  the-  Advisory 
Council.  Many  educational  and  research  groups  have  expressed 
keen  Interest  In  these  studies  and  will  be  kept  fully  Informed. 

A  series  of  reports  will  be  made  to  educational  agencies  through¬ 
out  the  country.  Reports  will  go  to  the  cooperating  school 
systems,  to  schools  of  education,  to  state  departments  of 
education,  and  to  private  educational  associations^  as  well 
as  to  the  supporting  agencies.  Results  will  also  be  of  Interest 
to  parents,  to  Industry,  to  the  military  services,  and  to  anyone 
concerned  with  education  and-  the  optimum  development  and  use  of 
human  talents,  at  all  levels. 


The  responsihility  for  administering  the  tests  of  all 
sorts  and  collecting  the  data  about  the  students  and  their 
past  experiences  was  placed  directly  in  the  hands  of  the 
selected  schools.  The  scientific  analysis  of  the  original 
data  and  the  collection  of  the  follow-up  data  are  helzig 
accomplished  under  the  direction  of  the  program  stcrff  of 
the  University  of  Pittsbvirgsh  with  special  assistance  from 
the  American  Institute  for  Research. 

Collecting  the  Data 

In  the  late  spring  of  i960,  the  two-de^  battery  of 
approximately  30  psychological,  educational,  and  background 
measures  was  administered  to  the  students  in  five  percent 
of  the  nation's  hi^  schools.  There  were  Wo,000  stixdents 
tested  in  I353  secondary  schools.  This  will  provide  a  base 
line  of  the  measurable  characteristics  of  a  large  repre¬ 
sentative  sample  of  hi^  school  students.  Since  it  is  plan¬ 
ned  to  seciore  national  norms  for  one  complete  eige  group 
(the  fifteen-year-olds),  the  hijdi  school  students  tested  had 
to  be  supplemented  by  a  sample  of  the  fifteen-year-olds  not 
enrolled  in  any  hi^  school.  Therefore  in  one- tenth  of  the 
school  districts  in  the  sample,  not  only  the  students  in  the 
selected  school  but  also  all  other  fifteen-yeeur-olds  resid¬ 
ing  in  the  district  were  tested.  This  category  includes 
fifteen-year-olds  who  are  still  in  elementary  school,  those 
idxo  have  dropped  out  of  school  without  graduating,  and  hlc^ 
school  graduates.  The  student  response  was  gratlfyingly 
favorable.  A  number  of  news  stories  reported  that  attendance 
was  noticeably  hi^r  on  the  days  of  testing. 

The  original  data,  Incliidlng  the  individual  item 
responses  on  life  history  items,  activities,  and  interest 
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tests,  are  'being  preserved  to  con^iare  with  later  sashes  of 
Iji^rtant  'behavioral  neasvires  during  the  follow-up  study. 

The  Tests 

The  two-day  battery  of  tests  was  designed  to  "be  repre¬ 
sentative  of  the  types  of  aptitude,  achievement.  Interest, 
and  personality  tests  that  have  'been  proven  tiseful  and 
Important  in  selection,  measurement,  and  guidance  of  young 
people  at  the  secondary  school  level.  The  test  'battery 
Includes  questionnaires  to  obtain  Important  background  and 
life  history  Information  regarding  the  previous  experiences 
of  the  students,  their  neighborhood,  family,  community,  etc. 
There  are  also  measures  of  their  motivations,  levels  of 
vocational  and  economic  aspiration,  veQ-ue  systems,  and  per¬ 
sonal  plans.  The  tests  were  designed  to  measure  the  func¬ 


tions  covered  by  most  of  the  standardized  tests  now  widely 
used  with  high  school  students. 

All  tests  used  in  the  project  were  prei>ared  especially 
for  this  research,  following  detailed  specifications  devel¬ 
oped  'by  the  staff  and  Advisory  Panel  after  a  year's  inten¬ 
sive  study.  No  test  is  an  exact  parallel  of  any  existing 
commercial  test.  The  tests  will  be  withheld  from  subsequent 


publication  and  will  be  resei’ved  for  use  in  research  and  in 


the  standardization  of  other  tests.  The  test  types  used  were: 


1. 


Information 

a.  'Vocabulary  h. 

b.  Literat\u:e  1. 

c .  Music  J . 

d.  Social  Studies  k. 

e.  Mathematics  1. 


f .  Physical  Sciences  m. 

g.  Biological  Sciences  n. 


Aeronautics,  and  Space 

Electricity  and  Elect- 

Mechemlcs  tronlcs 

Farming 

Home  Economics 

Sports 

Other  Etreas  of 
information 


2. 

Memory  for  Sentences 

9. 

Effective  E3q>resslon 

3. 

Memory  for  Words 

10. 

Word  Functions  in 

4. 

Disguised  Words 

11. 

Read§ng^^6a^fehen8lon 

5. 

Spelling 

12. 

Creativity 

6. 

Capitalization 

13. 

Mechanical  Beasoning 

7. 

Punctviatlon 

14. 

Visualization  in  Two 

8. 

En^lsh  Usage 

Dimensions 

t 


\ 


i 


i 


h 
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15. 

Visualization  in 

20. 

Arithmetic  Co]iq>utation 

Three  Dimensions 

21. 

.Table  Reeiding 

l6. 

Abstract  Reasoning 

22. 

Clerical  Checking 

17. 

Arithmetic  Reasoning 

23. 

Object  Inspection 

18, 

Mathematics  - 

Introductory 

24. 

Preferences 

19. 

Mathematics  - 

Advanced 

The 

Interest  Test  Includes 

material  similar  to  that  in 

several  of  the  more  popular  interest  inventories  now  being 
administered  to  hi^  school  students.  If  obtains  self- 
reports  of  interest  in  a  wide  variety  of  occupational  and 
professional  activities.  The  Stvident  Activities  Inventory 
is  also  of  the  self -description  form  and  includes  material 
similar  to  that  in  many  of  the  popular  personality  tests 
specifically  designed  for  high  school  students.  It  will  be 
scored  to  provide  indicators  of  several  aspects  of  the 
personality  and  temperament  of  the  normal  hi^  school, 
student . 

The  Student  Information  Blank  was  developed,  especially 
for  the  study  to  obtain  factual  life  history  information 
about  the  students.  Questions  were  designed  to  gather  in¬ 
formation  on  such  topics  as  school  and  family  background, 
socio -cultural  indicators,  activities  and  organizations, 
and  plans  for  after  high  school. 

Health  questions  were  developed  to  determine  the 
current  status  of  the  student’s  health,  as  well  as  to 
record  past  health  history. 

The  tests  are  described  in  detail  in  Chapter  VII. 

The  Schools  In  the  Study 

It  was  planned  to  select  the  schools  by  a  random 
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process  so  they  would  he  representative  of  all  the  secondary 
schools  in  the  United  States,  Five  percent  of  the  high 
schools  (grades  9-12)  were  to  be  selected.  Data  were  to  be 
gathered  for  all  of  the  students  in  each  school  selected. 

The  selection  took  into  account  such  factors  as  size  and 
type  of  school.  Some  of  the  leading  experts  on  sampling 
problems  in  the  coxmtry  were  used  as  consultants  in  deciding 
how  to  select  the  schools.  Of  the  1357  schools  selected, 
approximately  955  were  senior  high  schools  and  the  others 
were  the  associated  Junior  hl^  schools.  Ilhls  nimber  of 
schools  included  approximately  4l0,000  students. 

The  Follow-Up  Study 

Bach  group  of  high  school  students  will  be  followed  up 
approximately  one  year  after  the  con5>letion  of  their  high 
school  training  (or  when  they  normally  would  graduate  if 
they  drop  out  before  gradxiation) .  Thus,  the  12th  grade 
group  will  be  followed  up  in  the  summer  of  196lj  the  11th 
grade  group  in  1962;  the  10th  grade  group  in  I963;  and  the 
9th  grade  group  in  1964.  The  students  will  be  asked  to 
report  on  the  occupations  and  training  courses  actually- 
entered,  the  reasons  for  their  choices,  their  success  and 
satisfaction  with  the  activity  chosen,  marriage  s-tatus, 
present  plans  (including  marriage  plans),  changes  of  resi- 
dence^  and  other  related  facts  regarding  their  education, 
C6ureer>  and  suijustment.  This  information  will  then  be  com¬ 
pared  with  the  original  test  and  background  data  by 
appropriate  electax>nic  computing  equipment,  and  studies  of 
the  relationships  of  test  scores  euid  of  other  orlglnadly 
gathered  information  -to  -the  s-tatus  of  individuals  will  -then 


be  made. 


At  this  time  there  will  be  many  stvidles  to  estimate  the 
effects  of  various  treatments  (such  as  the  school's  educa¬ 
tional  procedures  or  .the  counseling  procedures)  on  later 
behavior  such  as  going  to  college,  entering  various  occupa¬ 
tions,  etc.  Yearly  reports  are  to  be  prepared  containing  the 
findings  in  the  analysis  of  each  successive  grade  group.  At 
the  end  of  the  one -year  follow-up,  valuable  new  information 
shotild  be  available  regarding  such  important  behaviors  as 
entering  college,  becoming  unemployed,  leaving  the  farm,  en¬ 
tering  the  Armed  Forces,  remaining  in  hlgjh  school  iintll 
graduation,  etc. 

It  is  also  proposed  that  there  be  follow-up  studies 
five  years,  ten  years,  and  twenty  years  after  gradioatlon 
from  higii  school.  This  would  provide  information  regarding 
college  courses,  the  first  year  of  occupational  experience 
following  college  graduation,  entry  into  graduate  training, 
early  work  experiences  for  persons  going  into  professional 
training,  marriage  e3q>erience,  re-enlistment  in  the  military, 
and  ultimately  an  estimate  of  the  significance  of  the  indi¬ 
vidual's  personal  adjustment,  satisfactions,  end  contribu¬ 
tions  in  relation  to  this  potentiality  as  revealed  in  the 
initial  testing  program.  These  follow-up  studies  will  be 
done  by  maintaining  continuous  contact  with  these  indi¬ 
viduals  and  by  obtaining  information  from  them  at  periodic 
intervals.  Every  effort  is  being  made  to  plan  the  study  in 
such  a  way  as  to  maximize  participant  cooperation  in  terms 
of  returning  questionnaires,  euiswerlng  correspondence,  etc. 

As  a  collateral  type  of  study,  a  "follow-back"  tech¬ 
nique  has  been  developed.  With  this  technique  it  is  possible 
to  do,  in  effect,  follow-up  studies  in  some  instances  where 
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the  original  link  of  communication  With’  the  subject  has  been 
broken.  .Jin  exsuuple  of  this  might  be  to  Obtain  a  list  of  all 
of  the  fellows  in  the  American  .Physical  Society  of  the  right 
age  range  twenty  years  after  the  test  administration  of  the 
study.  There  should,  be  a  substantial  number  of  these,  and 
five  percent  of  them  should  be  represented  in  the  original 
group  of  students.  The  total  list  of  names  would  be  matched 
with  the  list  in  the  study.  Name,  name  of  parents,  birth 
date,  high  school  attended,  year  of  graduation,  plus  other 
information  will  be  available  to  use  in  matching  records. 
This  group  could  then  be  compared  with  the  other  students 
to  discover  importeuit  differences  in  test  scores  and  be¬ 
havior  of  the  two  groups  while  in  high  school. 

Processing  the  Information  in  the  Study 

One  of  the  technological  break-througdis  making  this 
study  practical  and  feasible  at  this  time  has  been  the 
development  of  the  optical  sensing  electronic  scoring 
machines.  The  original  electrical  test  scoring  machines 
were  based  on  having  pencil  marks  on  an  answer  sheet  com¬ 
plete  the  circuits  between  two  tiny  blades  in  the  scoring 
machine  and  thus  send  a  pulse  over  a  dial  indicating  the 
score.  This  required  the  use  of  a  special  electrographic 
pencil  and  was  a  relatively  slow,  expensive,  and  not  com- 
p''etely  dependable  process.  With  optical  sensing,  the 
subject  makes  a  mark  on  the  emswer  sheet  with  ink  or  any 
opaque  materlsd  and  the  machine  senses  or  receives  the  re¬ 
sult  by  a  photoelectric  cell.  Qlxis  is  a  faur  more  reliable 
procedure  and  is  many  times  faster.  The  electronic  scoring 
machine  developed  by  Or.  E. .P.  Lindquist  at  the  University 
of  Iowa  will  score,  check,  print,  and  punch  cards  for  13 
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tests  at  a  time  at  the  rate  of  6000  euaswer  sheets  per  hour. 

In  later  operations  a  computer  converts  the  scores  to  a 
standard  scale,  and  prints  the  individual’s  name,  standard 
scores,  combined  scores,  and  other  desired  information. 

The  Lindquist  optical  scanning  automatic  punch  was  also 
employed.  This  reads  answer  sheets  end  pxinches  the  responses 
onto  IBM  cards  at  a  rate  of  6000  cards  per  hour. 

Electronic  data  processing  procedures  and  machines  now 
make  it  possible  to  store  hundreds  of  bits  of  detailed  in¬ 
formation  on  each  of  the  4-10,000  students  on  tapes  and  cards 
in  readily  accessible  form  for  the  many  important  types  of 
analyses  and  follow-up  studies. 

What  Will  Be  Done  With  The  Data 

Each  school  filled  out  approximately  50  pages  of 
questionnaire  material  regarding  its  educational  programs, 
characteristics,  activities,  guidance  program,  and  counselors, 
nearly  100  individual  test  scores  and  several  hundred  items 
of  information  about  life  history,  aims,  experiences,  plans, 
aspirations,  etc.,  were  obtained  for  each  student.  Several 
hundred  items  of  information  are  available  about  each 
school.  All  of  these  test  and  school  measures  will  event¬ 
ually  be  related  to  a  number  of  target  or  goal  pay-off 
variables  which  will  be  measures  of  Important  educational 
outcomes  and  life  outcomes.  A  basic  purpose  of  the  studies 
for  Project  TALENT  is  to  study  the  interrelationships  of 
each  test  or  school  measure  and  each  criterion  vari¬ 
able,  with  all  other  test  and  school  measures  held  constant. 
The  initial  approach  will  be  throu^  the  basic  procedure  of 
multiple-regression  analysis.  Hera,  for  the  large  numbers  of 
the  predictor  variables  (test  and  school  measures)  versus  a 


\  Blngle  goal  criterion  nteaeure  at  e  tlme^  partial  and  multiple 
correlatloas  will  be  computed. 

Ordinary  cozrelatlona  between  a  predictor  variable  and 
a  dependent  goal  criterion  measure  are  usually  difficult  to 
interpret  and  may  not  really  represent  the  true  specific  rela> 
tlonshlp  between  a  pair  of  measures.  A  striking  example  of 
tills  occurred  in  a  study  of  Naval  recruiting  some  years  ago. 

, It  was  foimd#  for  the  various  recruiting  areas  of  the  country, 
there  was  a  hlg^  negative  relationship  between  tilievproportlon 
of  faedlles  with  television  »etB  and  the  recruits  obtained 
from  the  area  per  thousand  population.  However,  a  multiple* 
regression  .:analy8is  shoved  that  there  was  actual.ly  a  zero  rela¬ 
tionship  between  television  sets  and  recruit  productivity  when 
other  measures  are  considered  and  held  constant.  This  was  a 
result  of  TV  sets  (at  that  time  -  .1950)  existing  mainly  in  the 
Ind:  trlallzed  areas  of  the  country.  There  was  a  true  unique 
relationship  between  degree  of  Indus tr led! zation  and  irecrult 
productivity.  This  remained  as  a  strong  relationship  when 
about  ho  variables  were  euialyzed  simultaneously,  whereas  the 
TV  relationship  vanished. 

It  is  .  planned  that  such  multiple  regression  studies  will 
be  carried  out  for  groups  of  90  to  100  measures  at  a  time 
against  a  specific  criterion  measure.  Such  measures  will 
Include  graduating  from  high  school,  going  to  college,  greules 
made  in  high  school,  grades  made  in  college,  the  occupation 
entered,  the  salary  received  after  a  number  of  years, 

>rtxether  the  student  has  migrated,  how  well  he  likes  his 
occupational  choice,  the  types  of  courses  he  takes  In  college, 
whether  he  becomes  a  scientist,  or  leader,  or  delinquent, 
or  something  else. 


Group  CoatpairlBon  Studies 


As  a  further  approach  in  exploring  the  relationships  in  the 
information  that  has  been  accumulated^  distributions  of  scores  will 
be  examined  for  large  numbers  of  special  groups  such  as: 

a.  Occupational  groups 

b.  Parental  occupation  groups 

c.  Regional  groups 

d.  Unusually  successful  groups  (creative) 

e.  Unusually  unsuccessful  groups  (delinquents^ 

psychiatric  cases^  etc.) 

f.  Migrants 

g.  Types  of  school 

h.  Groups  with  specific  attitudes  toward 

business^  saving,  spending 

i.  Groups  planning  military  careers 

After  the  first  round  of  these  studies  has  indicated 
potential  clusterings  of  the  variables*  interrelationships, 
more  complex  and  sophisticated  matched  group  comparisons  will 
be  made.  Here,  averages  and  other  statistics  will  be  computed 
for  all  measures  for  matched  groups  (groups  that  sure  alike  in 
H  dimensions  but  are  different  in  dimension  H  plus  l).  Ex¬ 
amples: 

a.  Students  alike  in  sex,  grade,  region,  socio¬ 
economic  status,  high  school  grades,  and 
total  Information  Test  score,  but  different 
in  planning  to  attend  college  (or  skipping  a 
grade,  failing  a  grade,  wanting  to  become  a 
scientist,  ability  to  write  a  pamgraph, 
self-concept,  basic  values,  etc.) 

b.  Schools  alike  In  type,  size,  and  pairental 
occupation  mix,  but  different  in  student- 
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teacher  ratio  (or  per  pupil  expenditure^ 
average  teacher  salary,  number  of  books  In 
library,  whether  In  a  specific  esqperlmental 
curriculum  group,  age  of  principal,  whether 
multiple  or  single  tra^,  percent  of  teachers 
'vAio  are  men,  courses  offered,  etc.) 

Expected  Results 

In  this  kind  of  scientific  study.  It  Is  possible  to 
know  In  advance  some  of  the  major  types  of  Infoznatlon 
which  will  be  produced. 

Some  of  the  Important  results  of  this  Xatlonal  Aptitude 
and  Ability  Census  will  be: 

An  Inventory  of  Hunan  Resoxuroes.  ’’Project  Talent"  will 
be  a  tremendous  Inventory  or  stocktaking  In  ;&lch  we  find 
out  the  eapabllltlee  of  o\ir  youth. 

We  also  plan  to  study  the  relationships  between  one 
kind  of  ability  and  another,  between  one  type  of  school 
course  and  another,  and  between  personal  hobbles  and  the 
development  of  many  iypes  of  competence. 

A  Set  of  Standards  for  EducatloneJ.  and  Psychological 
Measurement.  When  reliable  measures  have  been  Obtained 
from  thousands  of  persons  In  a  systematically  selected 
saa^le.  It  will  be  possible  to  provide  a  more  accurate  set 
of  benchmarks  or  standards  for  test  authors  to  use  In 
standardizing  tests  so  that  scores  Indicate  comparable 
levels  of  ablll'^. 

This  nay  be  roughly  ccnapared  to  the  basic  standards 
such  as  the  marked  beurs  for  neasxirlng  length,  or  the  stan<< 
dard  weights  which  the  Xatlonal  Bureau  of  Standards  main¬ 


tains  . 
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A  Gonprehenaive  Counseling  Guide  Indicating  the  Patterns 
of  Aptitude  and  Ability  Which  Are  I*redlctlve  of  Success  In 
Various  Careers.  In  the  follow-ups  after  the  national  ex¬ 
aminations  and  analysis,  students  who  took  the  tests  will 
be  located  suid  asked  to  report  on  educational  and  vocational 
experiences.  A  young  girl  may  have  become  a  secretary,  or  a 
housewife,  or  she  may  have  gone  to  college.  By  studying 
thousands  of  student  aptitude,  interest,  and  ability  pat¬ 
terns,  and  finding  out  Ihe  person's  later  activities  and 
occupations,  we  will  learn  a  great  deal.  This  will  help 
students  by  predicting  more  precisely  what  kinds  of  apti¬ 
tudes  and  abilities,  what  kinds  of  courses,  and  what  kinds 
of  interests  constitute  the  best  basis  for  various  kinds  of 
careers.  A  machinist  needs  good  mecheinical  ability,  a 
scientist  needs  mathematical  ability,  but  cotinselors  and 
teachers  know  that  many  other  factors  enter  into  the  quali¬ 
fications  for  success  in  a  career.  Motivation  is  a  necessary 
ingredient,  but  the  best  use  of  the  student's  special  talents 
requires  that  he  identify  this  talent  early  and  obtain  the 
education  essential  for  the  full  development  and  effective 
use  of  his  powers. 

It  is  anticipated  that  "Project  Talent"  will  make  a 
significant  contribution  toward  meeting  this  need:  better 
prediction,  based  on  actual  follow-ups,  of  a  yo\mg  person's 
chances  for  success  in  a  given  field.  To  some  extent,  this 
can  be  done  todc^,  and  it  has  been  an  enozmous  incentive  to 
teeu:hers,  young  people,  euMl  parents  to  be  told,  for  example, 
"This  boy  unquestionably  has  talent  in  a  given  direction. 

If  he  call  continue  his  education,  he  may  reasonably  expect 
to  master  his  chosen  trade  or  profession." 
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A  Better  Understanding  of  Hoy  Young  People  Choose 
Their  Life  Work.  Many  people  follow  their  fajnlly  treuie  or 
profession.  They  tend  to  think  that  people  know  quite 
early  what  their  life  work  will  be.  Other  people  drift 
Into  an  occupation  and  they  tend  to  thlrdc  that  everyone 
else  more-or-less  drifts  Into  a  particular  tirade,  business 
or  profession.  Many  people  feel  that  they  have  very  little 
choice. 

However,  many  people  today  do  have  a  choice,  and  the 
diversity  of  occupations  and  the  need  for  special  training 
continue  to  increase.  We  have  begun  to  learn  something 
about  the  processes  by  which  a  young  person  decides  that  he 
would  like  to  be  a  teacher,  a  lawyer,  or  an  apprentice  for 
a  trade.  This  study  and  others  can  help  us  understand  at 
irtiat  ages  certain  lifetime  careers  tend  to  be  chosen. 

Naturally,  high  school  seniors  talk  more  about  their 
future  careers  than  do  hi^  school  freshmen.  Yet  there  are 
many  indications  that  even  younger  children  already  have 
Interests  which  are  related  to  the  fields  in  idiich  they 
later  work. 

A  Better  Understanding  of  the  Baucatloneil  Experiences 
Which  Prepare  Students  for  Their  Life  Work.  American  edu¬ 
cation  is  noted  for  its  diversity.  Only  through  the  analysis 
of  detailed  infoimation  about  students,  their  educational 
experiences,  and  their  subsequent  successes  or  failures  caji 
we  hope  to  msdse  ovir  educational  system  as  flexible  and 
responsive  to  the  individual  needs  of  its  students  as  it 
must  be  if  o\ir  nation  is  to  continue  to  develop  and  prosper. 

"Project  Talent"  has  been  carefully  designed  to  fill 
an  lii5)ortant  national  need  for  facts  reg8o:d.ing  the 
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identification,  development,  and  utilization  of  our  human 
resources.  This  information  is  intended  as  a  basic  for 
^  manpower  policies,  and  as  a  basic  resource  for  the  many 

individuals  responsible  for  the  education  of  our  children. 

It  is  hopwd  that  the  study  may  lead  to  a  better  under¬ 
standing  of  mobility  of  adults  and  children  and  a  better 
understanding  of  educational  and  other  early  life  exper¬ 
iences  that  are  conducive  to  civic  leadership,  mental 
hea].th,  etc.,  in  adulthood. 

First  results  of  initial  studies  are  expected  to 
1/  become  available  early  in  196I.  The  results  of  the  first 

,  follow-up  study  should  become  available  about  eight  to 

t  twelve  months  later. 


m.-i 


I 


i 


CHAPTER  III 

SELECTING  THE  STUDENTS  AND  THE  SCHOOLS 

"One  school  in  the  mountains  of  Eastern  Kentucky  is 
reached  by  a  small  secondary  road  bounded  on  either  side  by 
steep  hills  heavily  wooded  with  pine.  Occasionally  the 
woods  open  sufficiently  to  reveal  a  cabin  with  an  out  build¬ 
ing  or  tvo,  then  the  trees  close  in  again,  the  steep  slopes 
silently  inhospitable  to  attempts  to  use  the  land  to  gain  a 
livelihood.  At  a  sharp  fork  in  the  road,  one  turns  to  the 
right  as  directed  and  the  road  dribbles  out  and  becomes  non¬ 
existent.  A  wide  shallow  brook  describes  a  graceful  axe  as 
it  sweeps  along  the  foot  of  the  hill  directly  ahead.  Across 
the  brook  is  a  school  and  accompemying  dormitories.  The 
dormitories  are  necessary,  for  the  isolated  and  rugged  coun¬ 
try  makes  daily  trips  to  and  from  school  impossible.  This 
is  Red  Bird  Settlement  School.”* 


*Letter  from  Regional  Coordinator 
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At  the  corner  of  W.  205  St.  and  Golden  Ave.  In  the 
Bronx,  in  New  York  City,  students  gather  from  all  over  the 
city  to  study  calculus  and  other  advanced  courses  in  sci¬ 
ence  and  mathematics.  A  high  proportion  of  them  will  even¬ 
tually  go  through  graduate  school  and  receive  a  Ph.D.  This 
is  the  Bronx  High  School  of  Science. 

Near  a  school  on  the  south  bank  of  the  Potomac  River, 
Gadsby' s  Tavern  still  stands  in  the  "Old  Town"  section  of 
Alexandria,  Virginia,  flanked  by  many  historic  old  homes  of 
the  same  period.  The  Tavern,  a  favorite  meeting  place  of 
George  Washington,  is  Just  a  few  blocks  from  the  George 
Washington  High  School. 

Off  a  residential  street  in  Washington,  D.  C.,  a  drive¬ 
way  sweeps  into  a  broad  arc  up  a  hill  in  front  of  the  main 
entrance  of  a  modem  parochial  secondary  school.  The  struc¬ 
ture  is  a  modern  brick  and  glass  design  on  the  outside  which 
carries  thro\agh  to  contemporary  functional  structure  on  the 
inside.  Swinging  through  the  glass  doors,  one  is  immediate¬ 
ly  Impressed  by  the  quiet  and  efficient  atmosphere.  Students 
move  from  room  to  room  with  a  bearing  which  seems  to  re¬ 
flect  their  pride  in  the  physical  plant  itself.  Adjoining 
the  school  is  a  modem  athletic  field  which  is  in  use  Just 
about  every  afternoon  after  school.  This  is  the  Archbishop 
Carroll  High  School. 

On  about  the  17th  of  November  1959  the  superintendents 
for  these  schools  opened  their  mail  and  read  a  letter  in¬ 
viting  them  to  peurtiicipate  in  Project  Talent.  Alawst  a 
thousand  other  superintendents  received  this  letter  at  the 
same  time.  The  schools  involved  medce  up  about  five  percent 
of  the  secondary  schools  in  all  50  states  of  the  United 
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States.  RoujplLy  one  school  out  of  every  twenty  was  Invited 
to  participate  in  Project  Talent,  the  first  national  survey 
of  aptitudes  and  achievement. 

How  the  Schools  were  Selected 

How  did  Red  Bird  Settlement  High  School  happen  to  par¬ 
ticipate  in  the  project?  How  did  the  Bronx  High  School  of 
Science  happen  to  participate?  And  how  did  each  of  the 
other  1,355  high  schools  happen  to  be  in  the  project?  Did 
they  volionteer?  Or  were  they  invited?  And  if  they  were  in 
the  project  by  invitation,  who  decided  what  schools  were  to 
be  invited?  And  on  what  basis  were  the  decisions  made? 

And  furthermore  how  can  a  talent  "census”  be  tsQcen  without 
testing  all  students  in  all  schools? 

The  answer  to  these  questions  is  a  rather  long  one  and 
if  it  gets  a  little  technical  in  spots,  we  hope  the  readers 
will  bear  with  us,  because  the  selection  of  the  schools  was 
a  cornerstone  of  the  project. 

Only  rarely  is  a  census  study  based  on  information 
gathered  from  100  percent  of  the  Individuals  in  the  group. 
For  instance,  in  a  high  proportion  of  the  surveys  carried 
out  by  the  Bureau  of  the  Census,  the  Bureau  of  Labor  Sta¬ 
tistics,  the  Department  of  Agriculture,  and  other  govern¬ 
mental  organizations,  only  part  of  the  group  is  studied, 
scmetimes  a  very  small  part.  In  industrial  and  commercial 
ox>eratlon8  too,  decisions  as  to  whether  the  product  meets 
the  standards  are  usually  based  on  inspection  of  only  a 
very  small  proportion  of  the  total  production.  It  would 
be  in5»ractical  to  grade  a  carload  of  wheat  or  a  bale  of 
cotton  on  any  other  basis.  Similarly,  only  a  portion  of  the 
total  group  of  American  high  school  students  was  included 
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in  Project  Talent. 

But  unless  the  participants  in  the  study  were  an  appro¬ 
priate  group,  one  that  was  sufficiently  representative  of 
high  school  students  in  the  country  as  a  whole,  the  objec¬ 
tives  ,pf  the  study  could  not  be  met;  it  would  be  impossible 
to  use  the  results  to  draw  sounc  'erences  about  "the  Ameri¬ 
can  high  school"  or  "the  American  high  school  student".  The 
"national  census  of  talents"  would  be  a  miscount,  and  infer¬ 
ences  based  on  it  misleading.  Hence,  in  planning  the  pro¬ 
ject,  there  had  to  be  tremendous  stress  on  using  sound  meth¬ 
ods  of  determining  what  schools  would  have  the  opportunity 
to  participate.  Nothing  could  be  left  to  ohance--and  some¬ 
what  paradoxically  almost  everything  hetd  to  be  left  to  chance. 
This  remark  will  probably  seem  enigmatic  to  anyone  who  is 
not  a  statistician  with  specialized  knowledge  in  the  area  of 
sampling  methodology.  The  authors  hope  that  by  the  time  the 
reader  has  finished  this  chapter  the  remark  will  no  longer 
seem  enigmatic. 

The  Problem  of  Sampling 

The  objectives  of  Project  Talent,  and  the  questions  to 
be  answered  by  it,  were  discussed  in  Chapter  II.  The  an¬ 
swers  to  these  questions  were  to  be  based  on  high  school 
students.  But  which  ones?  The  theoretically  ideal  solution 
would  have  been  to  test  all  high  school  students  in  the 
United  States.  But  this,  obviously,  would  have  been  utterly 
Impossible  from  any  practical  viewpoint.  There  eu:e  over 
10, OCX}, 000  secondary  school  students  in  public  and  private 
high  schools.  Limitations  on  available  money,  manpower, 
and  time  mesmt  that  it  would  be  out  of  the  question  to  test 
more  than  about  one-twentieth  of  these  students  at  the  very 
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tiost.  Tbe  question  that  then  arises  Is  "Which  twentieth?". 
This  Is  the  essence  of  the  "saopllng  problem".  In  Its  tech¬ 
nical  sense  the  word  "sample"  means  a  sub-group  chosen  from 
a  total  group  (technically  called  a  "population")  for  the 
purpose  of  getting  Information  on  the  basis  of  which  Infer¬ 
ences  can  be  drawn  about  the  total  group. 

In  the  case  of  Project  Talent,  the  basic  "population" 
about  which  Information  Is  sought  consists  of  the  total  group 
of  high  school  students  In  the  United  States,  In  Grades  9 
through  12. 

In  any  situation  where  a  sample  Is  to  be  chosen  there 
are  three  basic  ways  In  which  It  might  be  done;  let  us  call 
these  methods  the  "method  of  available  cases",  the  "quota 
method",  and  the  "random  sampling  method". 

The  method  of  available  cases  Is  by  far  the  least  satis¬ 
factory  of  the  three.  No  principle  underlies  It  except  that 
of  expediency.  The  method  Is  Just  what  Its  name  implies. 

The  only  reason  for  inclusion  in  the  sub-group  Is  willing¬ 
ness  to  be  in  it.  The  way  this  method  would  apply  to  Project 
Talent  might  be  as  follows.  Suppose  It  had  been  decided  to 
have  the  Project  Talent  sample  consist  of  I3OO  of  the  approx¬ 
imately  26,000  high  schools  in  the  United  States.  The  first 
1300  schools  that  volunteered  would  constitute  the  sample. 
This  would  obviously  not  be  a  representative  group.  Volun¬ 
teers  are  seldom  representative  of  non- volunteers;  ask  any 
Army  man!  The  mere  fact  of  having  volunteered  would  In  it¬ 
self  constitute  an  Importcmt  difference.  Now  suppose  that 
fewer  than  the  requisite  I3OO  schools  volunteered  spontan¬ 
eously.  The  next  step,  if  the  "method  of  available  cases" 
were  still  being  used,  would  be  to  write  letters  to  eidditlon- 


al  schools  inviting  them  to  participate.  Names  of  those  ad¬ 
ditional  schools  would  be  taken  from  any  handy  source- -a 
mailing  list  that  happened  to  be  on  hand,  the  membership  list 
of  some  association,  or  any  other  source  or  sources  that 
would  provide  the  requisite  number  of  schools.  Some  of  the 
invited  schools  would  agree  to  participate  and  others  would 
decline.  But  more  could  be  invited  until  the  total  number 
of  participants  was  deemed  sufficiently  impressive.  No  mat¬ 
ter  that  they  would  not  be  representative!  One  of  the  more 
spectacular  examples  of  the  deficiencies  of  the  "method  of 
available  cases"  was  a  poll  conducted  just  prior  to  the  1936 
presidential  election.  The  people  polled  were  chosen  from 
lists  of  automobile  registrations,  telephone  directories, 
and  other  convenient  sources,  and  on  the  basis  of  this  not- 
at-all  representative  sample,  a  Republican  victory  was  pre¬ 
dicted.  The  voters,  however,  did  not  cooperate.  There  was 
a  Democratic  landslide  and  the  magazine  which  had  conducted 
the  poll,  the  Literary  Digest,  went  out  of  business  soon  af¬ 
ter. 

What  are  the  alternatives?  Does  the  cure  lie  in  speci¬ 
fying  that  certain  important  characteristics  must  appear  in 
the  sample  in  the  same  proportion  as  in  the  "population"? 

For  instance,  one  might  specify  that  the  proportion  of  public, 
parochial,  and  private  schools  in  the  sample  must  be  the  same 
as  in  the  "population",  not  only  on  an  overall  basis,  but  also 
within  each  state.  Having  thus  set  up  "quotas"  for  public 
schools  from  Colorado,  peurochial  schools  from  MlcMgcui,  etc., 
one  would  still  select  schools  from  any  list  that  happened  to 
be  handy— or  accept  those  that  volunteered- -until  the  quotas 


were  filled. 
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Thi8_J.B  the  "quota  method".  The  number  of  individuals 
v^th  a  peirticular  characteristic  or  set  of  characteristics 
is  specified  in  ad^ratnce.  The  fact  that  these  "quotas"  are 
set  in  such  a  vay  that  they  are  at  least  roughly  proportion¬ 
al  to  the  incidence  of  the  characteristics  in  the  "population" 
as  a  vhole  constitutes  a  great  improvement  over  the  "method 
of  available  cases’*.  But  some  of  the  major  disetdvantages 
are  still  there.  The  sample  is  still  largely  self-selected 
or  selected  on  the  basis  of  convenience  and  availability. 

While  the  proportions  are  right  in  certain  specified  charsu:- 
teristics,  they  can  be  very  badly  off  in  regard  to  other  Im¬ 
portant  characteristics. 

The  only  satisfactory  solution  known  is  to  make  the  se¬ 
lection  in  a  random  manner.  One  may  use  either  a  simple  ran¬ 
dom  sample  or  some  other  fom  of  "probability  sample"--a 
"stratified  random  sample",  for  instance. 

One  characteristic  of  a  simple  random  sample  is  that 
every  member  of  the  "population"  has  an  exactly  equal  chance 
of  being  in  the  sample.  To  obtain  a  simple  random  sample, 
some  procedure  must  be  set  up  for  drawing  the  sample  on  a 
strictly  random  basis,  and  in  drawing  the  sample  all  members 
of  the  "population"  must  be  treated  exactly  alike. 

As  applied  to  Project  Talent  this  would  mean  that  each 
school  must  have  an  opportunity  to  be  selected  for  the  sample 
and  that  the  probability  of  being  selected  must  be  the  same 
for  every  school.  A  reasonable  question  to  ask  is  "Would 
this  sijiiple  randcn  sao^llng  procedure  guarantee  a  represen¬ 
tative  sample?".  And  the  answer  is  "No".  The  sanqple  would 
probably  tend  to  be  representative  but  the  chances  that  it 
would  be  exactly  like  the  population  in  regard  to  any  sped- 
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fled  determinable  characteristics  are  small  indeed.  For  ex¬ 
ample,  suppose  that  of  the  high  schools  in  the  United 

States  are  in  California.  Does  this  mean  that  7*93^?^  of  the 
schools  in  the  sample  would  be  in  Califoniia?  Uo,  it  does 
not!  Chance  doesn't  operate  that  way.  Maybe  fewer  than  6^ 
of  the  schools  in  the  sample  would  be  in  California;  maybe 

over  9^  would  be.  In  other  words,  with  a  large  sample  the  , 

) 

proportions  would  probably  be  fairly  close  bu-  not  exact. 

One  would  know  after  the  sample  had  been  selected  how  good  it 
was  in  this  respect.  But  what  about  the  characteristics  that 
may  be  important  but  cannot  be  measured  or  otherwise  deter¬ 
mined?  Will  the  sample  be  representative  in  terms  of  these 
imponderables?  Consider,  for  example,  the  enthusiasm  of  the  ’ 

teachers.  Surely  this  is  a  factor  which  has  some  bearing  on  » 

the  effectiveness  of  the  school.  But  it  is  a  factor  that  i* 

cannot  be  quantified  accurately  at  present  and  perhaps  never 
will  be  quantifiable.  Would  a  simple  random  sample  of  schools 
be  representative  in  terms  of  the  average  level  of  enthusiasm 
among  the  teachers  in  the  school?  The  answer  is  the  same  as 
for  readily  determinable  characteristics  such  as  the  state  in 
which  the  school  is  located.  The  sample  would  tend  towards 
representativeness,  but  would  probably  not  be  exactly  repre¬ 
sentative.  In  other  words  it  would  be  a  good  sample — but 
would  it  be  good  enough?  As  a  matter  of  fact  it  probably 
would  be  good  enough  to  give  acceptable  results;  but  it  is 
possible  to  do  better  than  that.  The  reader  will  recall  that 
the  "quota  method"  has  one  advantage  that  the  simple  random 
sampling  method  lacks.  If  the  quota  method  is  used  and  if 
the  quotas  are  set  up  properly,  it  is  possible  to  gmrantee 
that  the  sample  will  be  representative,  at  least  with  respect 
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to  the  characteristics  in  terns  of  which  quotas  are  sx>ecl- 
fled.  For  instance,  if  quotas  are  specific  for  schools  of 
various  sizes,  these  quotas  can  he  set  in  such  a  way  that  the 
representation  of  various-sized  schools  in  the  sanqsle  will  be 
proportional  to  their  representation  in  the  "population  of 
schools".  This  advantage  of  the  quota  method  can  be  combined 
with  the  advantages  of  random  saaqplliig  by  adopting  a  device 
called  "stratiHbd  random  sai)q)ling".  This  consists  in  divid¬ 
ing  the  population  (e.g. ,  the  schools)  into  groups  which. are 
similar  in  regard  to  one  or  more  characteristics  (for  in¬ 
stance,  location,  size,  type,  etc.).  The  "quota"  for  each 
of  these  homogeneous  groins,  which  in  the  plural  are  called 
"strata"  (singular:  "stratum"),  is  a  specified  proportion 
of  the  total  number  of  members  of  the  stratum.  Thus  far  this 
description  will  probably  seem  to  the  reader  to  be  a  straight 
description  of  the  quota  method;  and  that  is  exactly  what  it 
is- -thus  far.  The  difference  comes  in  at  the  point  where  the 
sasq>le  is  actually  chosen. 

Within  each  stratum,  a  strictly  reuadom  selection  proce¬ 
dure  is  used.  Every  school  in  the  stratum  is  treated  on  ex¬ 
actly  the  same  basis  as  every  other;  chance  alone  determines 
which  schools  within  the  stratvm  cure  chosen  to  constitute  the 
quota.  This  makes  it  possible  to  guarantee  that'  the  sample 
will  be  representative  in  regaod  to  the  characteristics  speci¬ 
fied  by  the  strata.  True,  it  is  not  feasible  to  specify  all 
the  relevant  characteristics.  Scziw  are  iiiq)onderables,  not 
capable  of  being  quantified,  or  indicated  in  objective  terns 
(teacher  enthusiasm  was  given  as  an  exaoqtle  of  this).  Other 
factors  that  not  only  are  relevant  and  liiq;>ortant  but  even  are 
capable  of  being  measured  may  be  overlooked,  because  in  our 
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present  stage  of  knowledge  their  importance  is  still  unknown 
or  overlooked.  Still  other  factors,  which  are  measurable 
and  of  recognized  importance,  may  nevertheless  have  to  be  e- 
liminated  as  bases  for  stratification  merely  because,  there 
are  practical  limits  to  the  number  of  different  characteris¬ 
tics  on  which  the  "population"  should  be  stratified.  If 
there  are  too  many  strata,  the  number  of  members  in  many  of 
them  will  be  too  small,  so  tliat  their  theorcticol  represen¬ 
tation  in  the  sample  will  be  fractional--which. is  always  in¬ 
convenient  and  usually  impossible.  In  view  of  the  fact  that 
there  is  thus  an  upper  limit  on  the  number  of  "stratifica¬ 
tion  variables"  that  can  be  used,  what  about  the  relevant 
variables  that  are  not  used  as  bases  for  stratification? 

Will  the  sample  be  representative  in  regard  to  them?  The 
answer,  as  in  the  case  of  simple  random  sampling,  is  that  it 
will  tend  to,  but  that  it  will  not  be  exactly  representative. 
However,  it  is  likely  to  be  more  nearly  representative  on 
many  variables  when  stratified  on  some,  than  it  would  be  if 
there  had  been  no  stratification.  In  brief,  stratification 
makes  the  sample  more  representative  in  some  respects  and 
less  representative  in  none — a  fine  example  of  having  one's 
cake  and  eating  it  too.  In  view  of  this  admirable  feature, 
it  should  come  as  no  surprise  to  the  reader  that  stratified 
random  sampling  was  the  method  chosen  for  selecting  the  Pro¬ 
ject  Talent  sample.  The  characteristics  on  which  the  strati¬ 
fication  was  based  are  discussed  later  in  this  ciiapter. 

But  before  we  discuss  how  we  stratified  wii&t  we  sampled, 
it  is  necessary  to  explain  Just  what  it  was  that  we  did 
sample.  Or  to  put  it  more  technically,  what  kind  of  "saaq)- 
ling  unit"  was  used?  There  were. several  possibilities.  The 


prlmaxy  sanplliig  unit  mlgpit  have  been  the  student,  the  school 
a  specific  grade  In  a  specific  school,  the  school  system 
(vhlch  In  most  cases  vould  he  the  same  as  the  city,  tovn,  or 
tovnshlp),  the  county,  or  even  the  state.  If  the  first  of 
these  alternatives,  the  Individual  student,  vere  chosen  as 
the  sampling  unit.  It  vould  mean  that  each  student  vould  be 
chosen  at  randcm  Individually  to  be  In  the  sample.  The  fact 
that  any  partlculeur  student  had  been  chosen  vould  have  no 
bearing  whatever  on  whether  euiy  of  his  classmates  or  school¬ 
mates,  or  any  fellow-residents  of  his  tovn,  county,  or  state 
were  also  chosen.  At  the  other  extreme,  if  the  state  were 
the  primary  saa^ling  unit,  it  would  mean  that  perhaps  one  or 
two  or  more  states  would  be  chosen  at  random  from  among  the 
fifty,  and  that  then  only  students  In  the  selected  states 
would  be  tested.  This  would  not  be  a  good  way  of  doing  the 
san5)llng  for  Project  Talent.  There  are  enormous  differences 
among  states  in  regard  to  educational  standards  euid  many 
other  highly  relevemt  factors.  A  small  handful  of  states 
could  hardly  be  e:q>ected  to  represent  the  country  as  a  whole 
very  well. 

On  strictly  theoreticed.  grounds  the  ideal  procedure  for 
Project  Te0.ent  might  have  been  to  use  the  Individual  student 
as  the  sampling  unit,  since  this  would  have  made  It  possible 
to  draw  accurate  conclusions  about  American  high  school  stu¬ 
dents  In  general  on  the  basis  of  a  smaller  sample  than  with 
any  other  procedure.  But  from  any  realistic  vlevpoltxt  this 
"ideal  procedure"  vould  have  been  patently  Impractical.  Any 
procedure  vheraiby  a  small  fraction  of  the  students  In  a  class 
Is  taken  out  of  the  normal  classroom  routine  for  two  days  to 
t€ike  a  battery  of  tests  will  almost  certainly  disrupt  the 
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learning  schedule  of  the  rest  of  the  students  in  the  class. 
Most  school  administrators  feel  that  any  large  scale  compre¬ 
hensive  testing  program  is  most  likely  to  be  useful  if  re¬ 
sults  are  available  for  all  students  in  the  school,  or  at 
least  for  all  students  in  the  grade,  so  that  it  will  be  pos¬ 
sible  to  determine  how  any  student  stands  in  relation  to  his 
fellow- students --and  also  how  the  school  as  a  whole  stands 
in  relation  to  other  schools^  Or  to  state  the  ca.se,  aiiotiier 
way,  using  the  school  as  the  sampling  unit  and  testing  all 
students  within  the  selected  schools  has  the  following  ma¬ 
jor  advantages: 

1..  It  is  administratively  convenient. 

2.  The  results  for  the  individual  students  are 
more  useful,  both  to  the  student  and  to  the 
school,  when  results  are  available  for  all 
students  in  the  school. 

3>  It  provides  a  better  basis  for  research  on 

the  schools  themselves- -as  opposed  to  research 
on  the  students.  Certain  kinds  of  questions, 
requiring  comparisons  of  results  for  different 
kinds  of  schools,  can  be  answered  better  when 
data  are  available  for  all  students  in  the 
schools  concerned  than  w:iea  only  a  small  frac¬ 
tion  of  the  students  has  been  tested, even 
though  a  larger  number  of  schools  may  be  in¬ 
volved  under  the  latter  circvunstances. 

In  brief,  then,  it  was  decided  to  use  the  school  as  the 
sampling  unit,  and  to  test  all  students  in  selected  schools, 
not  only  because  this  seemed  to  be  the  practical  procedure 
closest  to  the  theoretically  ideal  but  impractical  procedure 
of  using  the  student  as  the  sampling  unit,  but  also  because 
it  had  theoretical  advantages  in  its  own  right.  (As  things 
later  turned  out,  it  was  agreed  to  depart  from  the’  chosen 
procedure  in  two  places--llew  York  City  and  Chicago— where 
the  school  administrators  preferred  to  have  more  schools 
tested  but  only  a  fraction  of  the  students  in  each  school. 


In  Kew  York  City  it  was  agreed  to  test  one  out  of  12  students 
In  every  high  school.  In  the  case  of  Chicago's  38  academic 
and  technical  high  schools  >  20  of  them  were  selected  at  ran.- 
dom  and  one-tenth  of  the  students  in  every  grade  in  every  se¬ 
lected  school  were  tested. ) 

More  specifically.  In  the  case  of  the  public  schools. 

In  situations  where  Junior  high  schools  existed,  the  sampling 
unit  was  to  be  the  senior  high  school  together  with  its  as¬ 
sociated  Jxanlor  high  8chool(s).  One  purpose  of  treating 
Junior  high  schools  this  way  was  to  maximize  the  extent  to 
which  all  four  grades  (9  through  12)  would  be  Included  for 
the  same  school  system.  This  special  treatment  of  Junior 
high  schools  was  not  deemed  necessary  in  the  case  of  private 
and  parochial  schools,  where  the  Junior  high  school  is  quite 
a  rarity. 

The  reader  will  recall  that  stratified  random  sampling 
was  the  method  that  had  been  agreed  upon,  but  that  the  de¬ 
cision  as  to  how  to  stratify  the  sampling  units  could  not  be 
made  until  it  had  been  decided  what  the  sampling  units  would 
be.  The  decision  that  the  sampling  unit  should  be  the  school 
inqposed  the  obvious  requirement  that  the  stratification  vari¬ 
ables  must  be  variables  applicable  to  the  school.  At  the 
same  time  they  were  to  be  variables  that  there  might  be  some 
reason  to  expect  would  be  related  to  level  of  test  scores  of 
the  students  in  the  school.  This  relation  might  exist  either 
because  the  chosen  stratification  variable  was  somehow  re¬ 
lated  to  the  average  ability  level  of  the  pupils  or  because 
it  was  related  in  some  important  way  to  the  nature  of  the 
school  program. 

The  primeuiT’  stratification  of  the  schools  was  on  the 
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basis  of  whether  they  were  public,  parochial,  or  private.* 


*Ab  used  In  this  report,  these  terns,  "paurochial  school" 
and  "private  school",  may  require  a  little  clarlflcatibn. 

In  the  Interests  of  brevity,  the  tern  "parochial  school"  Is 
used  to  designate  both  parochial  and  diocesan  schools  under 
the  auspices  of  the  Boman  Catholic  Church.  All  other  non> 
public  schools,  including  those  affiliated  with  churches 
other  than  the  Roman  Catholic,  are  designated  "private  school". 


Public  schools  were  then  stratified  on  the  basis  of  the  fol¬ 
lowing  three  variables: 

1.  School  size  (as  represented  by  12th  Grade  en¬ 
rollment) 

2.  Location  (primarily  in  terms  of  state) 

3.  Extent  of  school  drop-outs 

A  word  or  two  is  in  order  on  the  way  these  three  vari¬ 
ables  were  handled,  and  the  reasons  for  choosing  them. 

School  size.  School  size  was  considered  important  be¬ 
cause  if  a  school  is  very  small  it  cannot  offer  as  varied  a 
curriculum  as  a  larger  school,  except  at  much  greater  cost 
per  capita.  This,  incidentally,  is  one  of  the  major  theses 
of  James  Bryant  Conant's  widely  quoted  report  on  American 
high  schools.* 


*Conant ,  James  B. ,  The  American  High  School  Today. 
McGraw  Hill,  New  York,  1959 


Accordingly,  the  public  high  schools  were  divided  into  the 
following  four  strata  in  terns  of  Grade  12  enrollment  (or 
Grade  11  in  the  case  of  those  few  school  systems  in  the  South 
which  still  have  an  eleven-year  program): 

1)  Grade  12  enrollment:  under  25 

2)  "  "  "  :  25-99 


it 


'i 
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3)  Grade  12  enrollment:  100—399 

4)  "  :  400  or  more 

One  reason  for  splitting  the  grovips  In  this  particular 
vay  vas  so  that  tvo  of  the  four  groups  vould  consist  of 
schools  large  enoi^  to  meet  the  minimum  size  standard  rec- 
onmecded  by  Conant*  and  the  other  tvo  would  fall  to  meet 


-NGonant^  James  B. ,  The  American  High  School  Today. 
McGraw  Hill,  New  York,  1959 


this  standard. 

Another  advantage  of  this  kind  of  split  is  that  it 
would  help  insure  a  proper  representation  of  urban  and  rural 
schools,  since  most  of  the  extremely  small  schools  (those  in 
size  category,  r)  would  be  in  rural  areas. 

Location.  Eroeul  geographical  region  (e.g. ,  New  England, 
the  Southwest,  etc.)  was  an  Inqjortant  consideration  because 
of  regional  differences  in  the  economy,  the  nature  of  the 
IKJpulatlon,  and  the  character  of  the  schools.  The  eu:tual 
state  in  which  the  school  was  located  was  also  In^rtant  be¬ 
cause  of  the  fvuictlons  of  most  state  departments  of  education 
in  setting  standards  for  the  schools  emd  the  teachers,  re¬ 
quirements  for  high  school  diplomas,  etc.  Another  factor  to 
be  considered  in  connection  with  location  was  the  distinction 
between  very  large  cities, and  other  types  of  local  units, 
including  smaller  cities  and  villages.  The  geographical  stra¬ 
tification  procedure  that  was  followed  was  one  that  had  the 
advantage  of  taking  into  accoimt  these  three  lBq»rtant  con¬ 
siderations— broad  geographical  region,  specific  state,  and 
the  distinction  between  very  large  cities  and  other  local 
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units.  What  vas  done  was  to  divide  tbe  countzy  into  the 

following  36  geographical  units: 

a.  The  five  cities  with  populations  in  excess  of 
1,300^000  (New  York,  Chicago,  Los  Axxgeles, 
Pl^ladelphia,  Detroit). 

h.  The  50  states  exclud4.ng  the  five  cities  men¬ 
tioned  above. 

c.  The  District  of  Colvonbla. 

TThese  36  geographlced.  units  were  then  grouped  into  nine 
broad  geographical  regions*  amwatmiinWi^^ 


*The  nine  regions  are  the  same  as  those  used  by  the 
U.S.  Office  of  Education.  The  organization  of  the  56  geo¬ 
graphical.  units  of  Project  Talent  into  geographical  regions 
is  shown  in  Appendix  3A. 


Extent  of  school  drop-outs.  The  proportion  of  students 
that  drop  out  of  high  school  before  graduating  is  obviously 
a  significant  factor.  A  high  drop-out  rate  is  of  course  gen¬ 
erally  regarded  as  undesirable.  A  "retention  index",  repre¬ 
senting  the  tendency  for  the  students  to  remain  in  school  un¬ 
til  they  graduate,  was  therefore  computed  for  each  high  school 

and  used  as  a  basis  for  stratification.  The  retention  ratio 

in  the  '5T-'58  school  year 
was  defined  as  the  ratio  of  number  of  graduates /to  nvnnber  of 

tenth-graders^  in  ’58- '59. 

The  parochial  schools  and  the  private  schools  were  strati 
fled  into  the  56  geographlcsLl  units,  but  unlike  the  public 
schools,  they  were  not  stratified  on  school  size  or  retention 
ratio;  this  was  because  there  were  too  few  parochial  and  pri¬ 
vate  schools  to  make  it  feasible  to  stratify  them  into  so 


many  subdivi cions.  The  group  oi  parochial  schools  and  the 
group  of  private  schools  were  campled  separately. 

After  the  decision  had  been  made  that  the  school  was 
to  be  the  sampling  unit,  the  next  basic  question  was  w'nat 
"sampling  ratio"  should  be  used.  The  sampling  ratio  is  the 
proportion  of  the  "population"  (or  of  any  segment  of  the 
"population")  that  is  selected  for  inclusion  in  the  cample. 
Obviously,  how  high  the  ratio  needs  to  be  depends  chiefly 
on  how  large  the  sample  needs  tc  be  in  order  to  yield  de¬ 
pendable  results  in  subsequent  research  based  on  the  data. 

In  the  case  of  Project  Talent  it  was  'iecided  t'.-  aijn  at 
resting  tome'-here  between  400,000  and  500,000  students. 

There  were  several  reasons  why  so  large  a  number  seemed  de¬ 
sirable.  The  reader  will  recall  that  the  decision  to  use 
the  school  as  the  basic  campling  unit  necessitated  a  larger 
sample  than  would  have  been  required  if  the  individual  stu¬ 
dent  had  been  the  sampling  unit.  Furthermore,  it  was  real¬ 
ized  that  the  inltj.?,].  sample  would  have  to  be  extremely 
large  because  it  would  eventually  be  broken  into  so  many  dif¬ 
ferent  kinds  of  subdivisions  that  some  of  these  smaller  groups 
would  be  very  small  indeed.  Considering  only  the  initial 
breakdown,  it  was  going  to  be  necessary  to  obtain  information 
separately  for  each  grade,  and  v/ithin  grades  separately  for 
es-ch  sex.  But  then  information  would  also  be  needed  for  dif¬ 
ferent  sizes  of  schoolr, .  schools  in  different  parts  of  the 
country,  different  types  of  curricula,  and  a  vast  number  of 
other  kinds  of  categories  into  which  the  students  or  schools 
could  be  classified  immediately.  It  was  not  expected  that 
the  sample  would  include  enough  schools  from  each  state  to 
give  usable  information  about  individual  states.  Thus  it 
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was  explicitly  planned  not  to  get  state  noms.  However, 
there  did  have  to  he  enough  students  and  schools  included 
from  each  of  the  first ' eight*  of  the  nine  geographical  re- 


*The  ninth  area,  "non-contiguous  states”,  was  not  cov¬ 
ered  by  this  requirement  since  Alaska  and  Hawaii  were  not 
states  at  the  time  the  initial  plans  were  set  up* 


gions  ( shown  in  Appendix  3A)  to  provide  usable  information 
about  these  larger  areas.  For  instance  regional  norms  were 
to  be  obtained. 

In  addition  to  the  categories  already  mentioned  in  terms 
of  which  the  students  could  be  classified,  there  were  other 
bases  in  terms  of  which  it  would  be  important  to  classify 
the  students  and  analyze  the  data  after  the  follow-up  infor¬ 
mation  had  begun  to  come  in.  For  instance  the  results  would 
have  to  be  analyzable  separately  for  those  students  who  go 
to  college  and  those  who  do  not;  for  those  students  who  grad¬ 
uate  from  college  and  those  who  do  not;  for  students  who 
train  for  specific  professions;  for  individuals  who  enter  and 
attain  at  least  moderate  success  in  various  occupations;  and 
for  individuals  who  achieve  outstanding  success  in  various 
ways;  also,  at  the  other  end  of  the  scale,  for  those  students 
who  become  juvenile  delinquents  or  adult  criminals;  for  those 
who  are  chronically  unemployed;  for  those  who  show  other  evi¬ 
dences  of  severe  maleuijustment. 

In  view  of  the  fact  that  some  of  the  occupations  that 
are  extremely  important  from  the  standpoint  of  the  welfaure 
of  the  nation  (e.g. ,  nuclear  physicist)  would  ultimately  at¬ 
tract  only  a  very  small  percentage  of  the  high  school  stu¬ 
dents  tested,  a  very  large  number  of  cases  would  be  necessary 
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In  order  to  obtain  enough  cases  In  those  important  but  rela¬ 
tively  infrequent  occupations  that  worthwhile  infomation 
would  be  yielded  about  them.  And  even  In  the  case  of  more 
usual  professions^  such  as  dentist,  where  the  total  number 
of  persons  would  undoubtedly  be  larger,  they  might  have  to 
be  divided  Into  many  sub-groups,  homogeneous  In  terns  of  type 
of  community,  family  background,  high  school  curriculum,  size 
of  high  school,  sex  of  the  studenl^  the  grade  in  which  he 
was  when  the  Project  Talent  tests  were  administered,  and 
other  factors.  Since  divisions  of  this  sort  produce  such  a 
very  large  number  of  sub-groups,  the  sub-groups  themselves 
might  be-too  small  to  provide  useful  information  unless  the 
initial  size  of  the  Project  Talen-t|;  group  was  very  large:  in- 

t 

deed.  This  was  perhaps  the  major  consideration  that  led  to 
the  decision  to  aim  at  testing  close  to  half  a  million  stu¬ 
dents. 

A  second  problem  was  the  number  of  schools  that  would 
be  needed.  A  large  number  of  schools  would  be  needed  not 
only  to  insure  an  adequately  representative  group  of  students, 
but  also  because  it  was  anticipated  that  in  many  of  the  spec¬ 
ial  studies  to  be  carried  out  with  the  Project  Talent  data, 
the  schools,  rather  than  Individual  students,  would  be  the 
focus  of  concern.  This  made  it  Important  not  only  to  have 
an.  adequate  number  of  schools  represented  in  the  sanq>le,  but 
also  to  have  adequate  representation  of  each  of  the  various 
categories  of  schools:  urbeui  schools,  suburban  schools, 
rural  schools;  large  schools,  sreall  schools;  private  schools, 
public  schools;  schools  in  prosperous  neighborhoods,  schools 
in  depressed  areas;  schools  with  conventional  curricula, 
schools  with  experimental  curricvila;  schools  in  the  West, 
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schools  in  the  East,  schools  In  the  South;  academic  high 
schools,  commercial  high  schools.  Industrial  high  schools; 
comprehensive  high  schools.  It  was  decided  that  the  neces¬ 
sary  representation  of  different  kinds  of  school^  could  not 
begin  to  be  achieved  unless  there  were  about  800  senior  high 
schools  In  the  sample,  at  the  very  least.  Fortunately  this 
number,  800  senior  high  schools,  was  compatible  with  the  pre¬ 
viously  made  Independent  decision  that  it  would  be  desirable 
to  test  close  to  half  a  million  students.  Since  information 
available  from  the  Office  of  Education  records  suggested 
that  the  size  of  the  aversige  high  school  in  the  United  States 
was  somewhere  In  the  vicinity  of  500  students,  it  appeared 
that  the  800  schools  to  be  selected,  together  with  associa¬ 
ted  junior  high  schools,  would  probably  yield  the  necessary 
14-00,000  to  500,000  students.  This  was  a  happy  coincidence, 
but  it  did  not  solve  all  the  problems. 

One  of  the  biggest  problems  it  did  not  solve  was  the 
question  of  how  to  get  an  adequate  representation  of  the 
larger  public  high  schools.  There  are  a  great  many  more 
very  small  high  schools  in  the  United  States  than  very  large 
ones.  If  a  uniform  sampling  ratio  were  used  for  all  kinds 
of  high  schools,  and  if  this  sampling  ratio  were  set  to  give 
the  desired  total  number  of  high  schools  or  the  desired  to¬ 
tal  number  of  students,  the  sample  would  be  very  heavily 
loaded  with  extremely  small  schools  and  would  have  far  too 
few  of  the  very  large  schools  to  make  it  possible  to  deter¬ 
mine  effectively  the  relationship  between  size  of  school  aM 
test  results,  or  between  size  of  school  and  subsequent  acti¬ 
vities  of  the  student,  or,  for  that  matter,  between  size  of 
school  and  anything  else  that  might  be  of  concern.  The  solu- 
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tion  to  this  problem,  the  problem  of  having  the  public  school 
sanqple  contain  too  few  very  large  schools  and  too  many  veiy 
small  schools  to  be  efficient  for  some  types  of  analysis, 
lay  in  the  use  of  differential  saBQ>llng  ratios.  It  was  de¬ 
cided,  therefore,  to  use  a  basic  sampling  ratio  of  one  in 
20  for  medium-sized  schools,  a  much  larger  sampling  ratio, 
one  in  13,  for  the  largest  schools,  and  a  much  smaller  samp¬ 
ling  ratio,  one  in  50,  for  the  smaller  schools.  This  was 
Very  easy  to  aocomplish,  since  size  of  school  (defined  in 
terns  of  12th  Grade  enrollment)  was  one  of  the  variables 
which  had  been  chosen  as  a  basis  of  stratification.  The 
sampling  ratios  used  in  most  cases  for  the  public  senior 
high  schools  are  summarized  below: 

School  size  12th  Grade  Sanqpling 

stratum  enrollment  ratio 

1  under  25  1  :  XX  50 

2  and  3  25  -  399  1  :  20 

4  UOO  or  more  1  :  5®  13 

It  was  anticipated  that  this  would  provide  about  the  right 
number  of  students  with  due  allowance  for  expected  absences. 
Exceptions  to  these  specified  sampling  ratios  in  the  case  of 
New  York  City  and  Chicago  have  already  been  noted.  The  few 
other  exceptions  that  occiirred  sure  described  in  Appendix  3D* 
Naturally  it  was  planned  that  the  schools  would  be 
weighted  appropriately  in  the  analysis  of  the  data,  to  ad¬ 
just  for  the  differential  saBQ)ling  ratios.  To  state  the  situ¬ 
ation  in  its  simplest  tenns,  when  a  sampling  ratio  of  one  in 
5Q  is  used  eeich  school  selected  represents  50  schools;  like¬ 
wise  each  school  selected  on  the  basis  of  a  one  in  13  sang)- 
llng  ratio  represents  13  schools.  Therefore,  in  the  data 

I 

I  analysis  these  schools  should  be  given  weights  of  50  and  13 
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respectively.  Only  by  applying  appropriate  weights  to  the 
data  cem  results  be  obtained  which  penult  sound  Inferences 
about  the  total  population  of  high  schools  or  high  school 
students.  This  matter  of  assigning  school  weights  Is  dis¬ 
cussed  in  a  little  more  detail  in  Chapter  VI. 

For  the  parochial  and  private  schools,  on  which  no  stra¬ 
tification  except  geographies!  had  been  done,  a  sampling 
ratio  of  one  In  20  was  used  unlfonnly. 

One  of  the  complications  in  obtaining  a  representative 
sample  of  9th  Grade  public  school  students  was  the  fact  that 
where  Junior  high  schools  are  an  integral  part  of  the  school 
system,  9th  Grade  students  are  in  a  different  school  from 
the  10th,  11th,  and  12th  Grade  students.  This  would  create 
no  difficulty  if  there  were  always  a  complete  correspondence 
between  junior  high  schools  and  senior  high  schools--in  other 
words,  if  all  graduates  of  a  particular  junior  high  school 
(or  group  of  junior  high  schools)  were  expected  to  go  to  a 
particular  senior  high  school  and  If  all  10th  Graders  in 
that  high  school  were  expected  to  come  from  ;the  junior  high  . 
school  (or  group  of  junior  high  schools)  in  question.  This 
convenient  state  of  affairs  exists  in  many  communities,  but 
in  enough  others  to  create  technical  problems  in  the  san5)ling, 
the  situation  is  more  complicated;  for  instance  some  gradu¬ 
ates  of  a  junior  high  school  may  go  to  one  senior  high  school 
and  some  to  another.  One  solution,  of  course,  would  have 
been  to  treat  the  junior  high  schools  just  like  the  senior 
high  schools,  selecting  a  sample  of  them  randomly  within  each 
stratum.  But  this  was  undesirable  because  It  wovild  have 
greatly  reduced  the  number  of  school  systems  on  which  data 
were  available  for  all  four  of  the  grades  involved  (Grades 
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9,  10,  11,  12).  This  could  have  seriously  liaited  the  use¬ 


fulness  of  the  data  in  special  studies  where  the  school, 
rather  than  the  student,  was  the  focus  of  concern;  also 
studies  where  the  pattern  of  differences  between  successive 
grades  was  of  primary  interest.  It  was  decided,  therefore, 
to  attempt  to  select  the  Junior  high  schools  in  such  a  way 
as  to  maximize  their  correspondence  with  the  senior  high 
schools  already  selected,  while  still  maintaining  due  regard 
for  the  tenets  of  random  sampling.  Where  Junior  high  schools 
or  groups  of  Junior  high  schools  were  clearly  and  unambigu¬ 
ously  associated  with  a  specific  senior  high  school  that  had 
been  selected,  those  Junior  high  schools  were  put  in  the 
sample.  In  commxanitles  where  the  situation  was  not  so  clear- 
cut,  there  was  a  problem  of  deciding  what  Junior  high  school 
or  group  of  Junior  high  schools  would  include  the  maximm 
nmber  of  students  who  would  go  to  the  selected  senior  high 
school  and  the  minimum  number  who  would  go  to  any  other 
senior  high  school.  At  the  sample  selection  stage  this  prob¬ 
lem  did  not  seem  susceptible  of  mathematical  treatment  on  any 
practical  basis.  It  was  therefore  a  matter  of  Judgment. 

The  necessary  decisions  were  delegated  to  the  appropriate 
R egional  C oordinators — the  persons  connected  with  the  pro¬ 
ject  who  were  in  the  best  position  to  obtain  the  needed  in¬ 
formation  directly  from  the  schools.  Though  the  sample  se¬ 
lection  procedure  for  Junior  high  schools  was  necessarily  an 
approximative  one,  to  a  certain  extent  resultant  inaccuracies 
could  be  corrected.  This  could  be  accomplished  partly  by 
means  of  a  siqpplementeuy  sampling  phase  in  which  a  small  nxan- 
ber  of  Junior  high  schools  were  chosen  randomly  from  an  ap¬ 
propriate  groups  and  partly  by  means  of  appropriate  adjustment 


of  the  weights  to  be  assigned  to  each  of  the  Junior  high 
schools  in  the  sample.  The  details  of  the  supplementary 
sampling  of  Junior  high  schools  axe  presented  in  Appendix 
3C.  The  problem  of  assigning  appropriate  weights  to  the 
schools  is  discussed  in  some  detail  in  Chapter  VI. 

In  connection  with  the  way  the  schools  were  selected, 
there  is  one  possible  source  of  misunderstanding  that  re¬ 
quires  clarification.  It  is  extremely  important  to  recog¬ 
nize  that  even  though  a  school  which  is  selected  turns  out 
to  be  located  in  some  particular  city  or  to  have  certain 
characteristics,  the  individual  school  is  not  necessarily 
representative  of  all  the  schools  located  in  that  city  or 
having  that  characteristic;  nor  is  it  expected  to  be.  Thus 
if  one  of  the  l6  schools  in  a  certain  city  happens  to  be 
drawn  it  may  not  be  a  typical  one.  It  might  be  the  worst 
school  in  the  city— or  the  best.  It  might  be  the  largest, 
or  it  might  be  the  smallest.  But  when  combined  with  other 
schools  selected  in  the  same  way  in  all  parts  of  the  country, 
it  should  contribute  towards  making  the  nation-wide  sample 
a  representative  one.  Thus  its  sole  function  in  the  sample 
is  to  contribute  to  the  composite,  along  with  many  other 
schools,  so  that  a  clear  picture  can  be  obtained  of  the  na¬ 
ture  of  American  high  schools  and  American  high  school  stu¬ 
dents  in  general.  If  the  total  sample  of  schools  is  to  give 
an  accurate  pictvire  of  the  country  as  a  whole,  schools  that 
are  not  typical  of  those  in  their  locality  have  to  have  the 
same  chance  of  being  represented  as  do  the  more  typical 
schools. 

As  has  been  mentioned  in  Chapter  II , :  one  important  part 
of  Project  Talent  was  to  collect  information  on  one  entire 
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age  group.  (Fifteen-year-olds  happened  to  he  the  age  group 
selected. )  This  meant  the  data  had  to  he  obtained  not  only 
for  the  15 -year-olds  in  high  school  hut  also  for  the  ones 
not  in  high  school.  This  would  include,  of  course,  15-year- 
olds  still  in  elementary  school  (Grade  8  or  helow) ,  or  in 
Junior  high  school  helow  the  Grade  9  level,  or  already  in 
college,  or  not  in  any  school  at  all.  The  latter  category 
would  include  those  who  had  already  graduated  hut  had  not 
entered  college  (such  cases  would  he  quite  rare)  and  those 
who  had  dropped  out  of  school  without  graduating.  The  non- 
high-  school  15 -year-olds  included  in  the  study  were  to  he 
the  residents  of  the  areas  served  hy  one-tenth  of  the  public 
senior  high  schools  selected  in  the  sample.  For  this  reasonj 
among  others,  the  schools  selected  in  the  sampling  phase  were 
divided  into  ten  sub-samples  which  in  terms  of  the  stratifi¬ 
cation  variables  would  he  as  close  to  equivalent  as  could 
reasonably  he  achieved.*  One  of  these  ten  sub-samples  (des- 


*Each  senior  high  school  was  assigned  to  one  of  the  ten 
sub-samples  on  the  basis  of  an  inspection  of  its  character¬ 
istics  in  terms  of  the  stratification  variables.  With  some 
minor  exceptions  where  missing  data  left  no  other  alterna¬ 
tive,  the  assignment  was  not  random,  since  the  purpose  was 
to  get  ten  sub-groups  that  would  be  as  similar  as  possible. 
Each  Junior  high  school  was  assigned  to  the  same  sub-group 
as  the  senior  high  school  with  which  it  was  associated — or 
in  cases  (such  as  Hew  York  City)  where  there  was  no  direct 
association  between  Junior  high  schools  and  specific  senior 
high  schools,  the  Junior  high  school  was  assigned  on  what¬ 
ever  other  basis  seemed  most  reasonable. 


Ignated  "Sub-sample  0")  was  then  selected  to  define  the  non- 
high-school  15-ye8ur-olds  to  be  included  in  the  study.  Those 
included  were  all  15-year-olds  not  registered  in  any  high 
school  (public,  parochial,  or  private)  in  Grade  9,  10,  11, 


or  12,  who  lived  in  the  school  district  served  by  any  of 
the  public  senior  hig5h  schools  in  "Sub-sample  0".  These 
non-high-school  15-year-oldB  are  not  intended  to  be  con¬ 
sidered  part  of  the  regular  sample.  However,  when  appro¬ 
priately  weighted  they  supplement  the  15 -year-olds  in  the 
regular  sample  (consisting  of  high  school  students)  to  pro¬ 
vide  a  picture  of  the  entire  a^e  group- -the  total  group  of 
15 -year-old  Americans. 

The  Mechanics  of  Selecting  the  Schools 

After  the  basic  decisions  on  how  to  select  the  sample 
were  made,  it  remained  to  actually  carry  out  the  selection 
procedure.  This  meant  getting  as  comprehensive  a  list  of 
the  high  schools  in  the  United  States  as  could  be  obtained, 
stratifying  them  on  the  agreed-upon  basis,  and  then  doing 
the  random  selection. 

The  comprehensive  list  of  schools  was  put  together 
from  several  different  sources.  The  bulk  of  the  information 
needed  was  provided  by  the  United  States  Office  of  Education, 
which  made  available  a  record  of  the  school  neunes,  locations, 
and  other  relevant  information  needed  for  stratification,  in 
the  form  of  a  file  of  IBM  cards,  for  most  of  the  public  sen¬ 
ior  high  schools  in  the  United  States.  This  was  supplemented 
by  three  lists  of  additional  schools  which  the  Office  of 
Education  later  provided,  and  by  a  mailing  list  of  schools 
that  the  Bureau  of  Internal  Revenue  provided,  which  happened 
to  contain  a  few  schools  not  on  the  Office  of  Education  list. 
In  addition,  the  Office  of  Education  provided  the  names  and 
addresses  of  the  parochial  and  private  high  schools.  The 
plan  of  operation  was  ,to  arrange  the  schools  in  "sub-sets" 
of  13,  20,  or  50,  whatever  number  corresponded  to  the  samp- 


ling  ratio  for  the  type  school  in  question.  The  schools 
within  each  sub-set  were  to  be  as  similar  as  possible  with 
relation  to  the  appropriate  stratification  variables.  One 
school  was  then  to  be  selected  at  random  from  each  sub-set. 

In  the  case  of  the  vast  majority  of  the  public  schools,  those 
for  which  the  Office  of  Education  had  provided  IBM  cards, 
it  was  possible  to  have  the  random  selection  actually  car¬ 
ried  out  by  an  electronic  computer,  the  "IBM-65O".  The 
machine  was  instructed,  or  to  use  the  Jargon  of  computer 
specialists,  the  machine  was  "programmed",  to  generate  a 
series  of  random  numbers,  which  designated  which  school  in 
each  sub-set  of  13  or  20  or  50  was  to  be  chosen.  The  IBM 
cards  were  fed  into  the  machine,  lights  lit,  wheels  spun, 
circuits  opened,  circuits  closed,  vacuum  tubes  operated, 
the  cards  were  "read",  and  computations  were  carried  out  at 
a  fantastic  rate  of  speed.  The  outcome  of  all  this  frenzied 
activity  on  the  part  of  the  "IBM-65O"  was  a  document  printed 
by  the  machine,  containing  machine-generated  instructions  to 
the  Project  staff!  This  document  was  in  the  form  of  a  list, 
specifying  what  schools  were  to  be  invited  to  participate  in 
the  project. 

For  the  private  schools,  the  parochial  schools,  and 
those  public  schools  for  which  IBM  cards  were  not  available, 
the  equivalent  process  had  to  be  carried  out  by  hand,  with 
the  aid  of  a  statistician*  s  tool  known  as  a  "table  of  rem- 
dom  nvonbers".  The  Internal  Revenue  list  and  each  of  the 
supplenenteury  lists  provided  by  the  Office  of  Education  were 
treated  separately  in  the  sampling  process.  Since  the  In¬ 
ternal  Revenue  list  provided  no  information  about  the  school 
except  address,  this  group  could  not  be  stratified,  and 
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therefore  a  simple  random  sample  of  2^  was  selected  from 
it.  There  were  a  few  other  very  minor  departures  from  the 
agreed-upon  sampling  ratios.  However,  In  all  cases  it  was 
later  possible  to  make  appropriate  eidjustments  in  the  school 
weights  to  correct  fully  for  these  discrepancies.  For  those 
who  may  be  interested,  the  details  are  discussed  in  Appendix 
3D,  which  also  contains  a  somewhat  more  detailed  descrip¬ 
tion  of  the  actual  mechanics  of  the  sampling  procedure. 
Response  to  Invitations  to  Participate 

The  preceding  sections  of  this  chapter  describe  at 
some  length  the  many  problems  that  had  to  be  met  and  the 
many  decisions  to  be  made  before  the  sample  could  actually 

be  selected;  there  is  also  some  hint  that  considerable  time 

■  ’  > 

and  effort  went  into  the  mechanics  of  actually  selecting  the 
schools.  All  this  time  and  all  this  effort  would  be  utterly 
in  vain  if  any  large  proportion  of  the  chosen  schools  were 
unwilling  to  cooperate.  If  this  occurs,  nothing  can'  be  done 
to  salvage  the  results  satisfactorily.  Choosing  other  schools 
to  invite  as  substitutes  is  no  solution,  for  about  the  same 
reason  that  depending  on  schools  to  volunteer  spontaneously 
is  not  a  desirable  method  of  sample  selection.  Just  as 
schools  that  volunteer  are  probably  not  representative  of 
those  that  do  not,  schools  that  decline.. to  participate  are 
likely  to  differ  somehow  from  schools  that  agree  to  partici¬ 
pate — and  one  can  never  know  how  much  the  results  have  been 
changed  as  a  result.  Fortunately,  in  the  case  of  Project 
Talent  this  turned  out  not  to  be  a  major  problem,  since  the 
schools  recognized  the  la^rtance  of  the  Project  and  were 
esiger  to  cooperate.  Almost  93  percent  of  the  schools  se¬ 
lected  in  the  sampling  process  agreed  to  participate-- 


really  aa  astonlahln^y  hl^  percentage,  and  one  vhlch  is 
a  tribute  both  to  the  zeal  of  the  Project's  Regional  Coordin¬ 
ators  and  to  the  vision  of  the  school  administrators,  vho 
recognized  the  immediate  and  lon£^texm  values  of  the  Project. 

Table  III-l  shovs  the  number  of  public,  parochial,  and 
private  senior  hl^  schools  invited  to  participate  In  each 
geographical  unit  (state  or  large  city)  and  the  number  that 
accepted  the  Invitation.  For  the  public  hl|^  schools  the 
school  size  category  Is  also  shown.  Vblle  retention  Index 
Is  not  shown  In  this  table  a  check  was  made  on  the  basis  of 
the  public  schools  for  which  the  Office  of  Education  had 
provided  IBM  cards.  This  comprised  almost  all  of  the  public 
schools.  Among  the  schools  selected  from  this  group  Mi-  had 
declined  to  participate.  Ro  evidence  was  found  that  these 
schools  were  biased  to  any  substantleLL  degree  In  regard  to 
retention  Index.* 


*The  retention  index  percentile  of  the  school  within 
the  groiqp  of  schools  in  the  sane  state  and  in  the  same 
school  size  category  was  determined.  The  median  of  these 
Ml-  percentiles  was  4^.  Two  thirds  of  the  M^  percentiles 
fell  between  14  and  89. 


Table  1  makes  It  clear  that  the  senior  hl^  schools 
gave  remarkably  good  cooperation.  In  the  Junior  high 
schools  the  plCtxnre  Is  every  bit  as  good,  since  there  was 
not  even  one  Instance  of  a  Junior  hl^  school  declining  to 
participate  If  it  had  been  determined  by  the  regional  coor 
dlnaftor  to  be  an  associated  school  for  one  of  the  senior 
hlc^  schools  that  had  agreed  to  participate.** 


*<iThere  were,  however,  three  refusals  among  the  Junior 
hlg^  schools  in  the  si^pplementary  Junior  hlc^  school  sanding 
mentioned  earlier  In  this  chapter  and  discussed  In  Appendix 
3C.  This  Is  hardly  surprising,  however,  since  the  circum¬ 
stances  were  such  that  these  schools  were  notified  very 
late  la  the  school  year. 

Since  the  proportion  of  sdiools  that  declined  to  per- 
tieipata  was  so  small,  the  problem  of  how  to  handle  the  sit¬ 
uation  WM  not  really  a  serious  one.  It  was  decided  that 
the  best  procedure  would  be  to  invite  no  additional  schools 
ad  replacements,  but  instead  to  give  a  higher  weight  to  the 
group  ot  schools  most  similar  to  the  mlssi^  school,  in  or¬ 
der  to  adjust  the  weighted  number  of  cases  so  that  It  would 
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correspond  with  the  number  of  cases  In  the  "population". 

The  other  aspect  of  the  saaqpling,  the  identification 
and  testing  of  15-yeeu*-olds  not  in  high  school  who  were 
living  in  designated  school  districts,  also  met  with  good 
cooperation. 

Although  exact  coxuits  ere  not  available  yet,  and  will 
not  be  until  f,  later  stage  in  the  data  processing  is  reached, 
it  would  appear  that  all  but  a  couple  of  hundred  15-year- 
olds  in  the  designated  school  districts  who  are  not  in  high 
school  were  tested. 

Special  Groups 

In  addition  to  the  students  in  Grades  9  through  12  in 
the  Junior  and  senior  high  schools  that  constituted  the  reg¬ 
ular  sample,  other  boys  and  girls  were  also  tested.  Inclu¬ 
ded  in  this  group,  of  course,  were  the  15-year-olds  who  were 
not  in  high  school;  they  have  alreewiy  been  discussed.  But 
in  addition  to  them  there  were  other  cases,  tested  either 
because  they  were  needed  for  inclusion  in  one  of  the  special 

studies  that  are  contemplated,  or  in  a  few  cases  chiefly  as 

the  students  in 

a  matter  of  convenience.  Sinceysuch  schools  cannot  be  con¬ 
sidered  part  of  the  regular  sample,  the  data  from  them  will 
not  be  included  routinely  in  all  studies;  such  schools  will 
be  included  only  in  those  special  studies  in  which  they  are 
appropriate. 

The  reasons  for  testing  these  various  groups  of  boys 
and  girls  who  are  neither  in  the  regular  san^le  of  Grade  9 
through  12  students  nor  in  the  saiq>le  of  15-year-olds  eure 
many  emd  varied.  However,  a  relatively  small  nuaiber  of 
categories  account  for  most  of  these  eidditloneLL  cases. 

For  instance,  there  were  a  few  places  where  one  school 
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In  a  community  vas  selected  In  the  random  sanqpllng  and  the 
school  authorities  wished  to  test  the  other  local  schools  as 
well.  The  desired  arrangements  were  made,  hu'^  since  the  ad¬ 
ditional  schools  were  not  drawn  In  the  random  sampling  pro¬ 
cess,  they  are  not  considered  part  of  the  regular  sample; 
the  data  from  them  will  therefore  he  included  only  In  those 
special  studies  in  which  It  is  appropriate  to  do  so. 

Then  there  are  the  eighth-graders.  Many  of  the  15- 
year-olds  not  in  high  school  turned  out  to  he  in  elementary 
school  in  Grade  8.  Rather  than  disrupt  a  class  which  had 
many  15-year-olds  hy  giving  the  Talent  battery  to  only  a 
fraction  of  the  class,  a  substantial  number  of  the  elementary 
schools  decided  to  test  their  entire  eighth  grade— all  the 
pupils,  regardless  of  their  age. 

Then  there  la  Knoxville,  Tennessee,  and  the  surrounding 
county,  Knox  County.  Two  schools  were  drawn  as  i>axt  of  the 
regular  sample  in  this  area,  but  as  a  result  of  the  enthusi¬ 
asm  of  the  school  authorities  there  it  was  possible  to  ar¬ 
range  to  test  every  student  in  every  school --public,  parochial, 
and  private  in  the  entire  Kioxville  and  fiiox  County  area, 
not  only  Grades  9  through  12,  but  also  Grade  8.  This  very 
comprehensive  testing  in  a  concentrated  area,  over  a  five- 
grade  range,  will  make  possible  many  special  studies  that 
could  not  otherwise  be  carried  out. 

And  last  but  by  no  means  least  is  .  a  small  group  of  se¬ 
lected  schools  which  are  among  those  that  1.  :ve  been  trying 
out  experimental  curricula  In  mathematics.  Two  experimental 
curricula  are  Involved  here--one  developed  by  Dr.  E.  G. 

Begle  of  Yale  University  and  one  by  Dr.  Meuc  Beberman  of  the 
University  of  Illinois.  It  is  planned  to  undertake  some 
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special  Btxidies  of  the  Talent  data,  to  compare  the  perfom- 
ance  of  students  In  these  experimental  cxirrlcula  vlth  that 
of  matched  groups  vho  take  the  conventional  kind  of  high 


school  mathematics  courses 
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Appendix  3A.  List  of  the  36  basic  geographical  vinits*, 
classified  Into  regions  ^ 


1.  New  England  (6  geog.  units) 

111  Maine 

112  Nev  Hampshire 

113  Vermont 

114  Massachusetts 

115  Rhode  Island 

116  Connecticut 

2.  Mid-east  (8  geog.  units) 

2X1  New  York  City*** 

221  Nev  York  (except  N.Y.C.) 

222  Nev  Jersey 

2x3  Philadelphia**# 

223  Pennsylvania  (exe^t  Fhlla. 

23^  Delaware 
255  Maryland 
230  District  of  Columbia 

3.  Great  Lakes  (7  geog.  units) 

331  Ohio 

332  Indiana 
3x3  Chicago*** 

333  Illinois  (except  Chicago) 
3XU  Detroit*** 

33*<-  Michigan  (except  Detroit) 
335  Wisconsin 

4.  Plains  (7  geog.  units) 

441  Minnesota 

442  Iowa 

443  Missouri 

444  North  Dakota 
44§  South  Dakota 

446  Nebraska 

447  Kansas 


5.  Southeast  (12  geog.  units) 

551  Virginia 
332  West  Virginia 

553  North  Carolina 

554  South  Carolina 

555  Georgia 

556  Florida 

561  Ifontueky 

562  Tezmessee 

563  Alabana 

564  Mississippi 

571  Arkansas 

572  Louisiana 

6.  Southwest  (4  geog.  units) 

671  Oklahoma 

672  Texas 

683  New  Mexico 
664  Arizona 

7.  Rocky  Mountains  (5  geog.  units) 

761  Montana 

782  Idaho 

783  V^omlng 

784  Colorado 

785  Utah 

8.  Far  West  (5  geog.  units) 

861  Nevada 

692  Washington 

893  Oregon 

8X4  Los  Angeles*** 

894  California  (except  Los 

Angeles) 


9.  Non-contiguous  (2  geog.  units) 

901  Alaska  ■ 

902  Hawaii 

*  ^  3'dlgit  number  preceding  the  name  of  the  geographical  unit  Is  the  code 
number  assigned  to  it  for  use  in  machine  processing. 


**  The  nine  regions  shown,  and  indicated  by  the  first  digit  of  the  geographical 
unit  code,  are  the  regions  used  by  the  U.S.  Office  of  Education.  The 
second  digit  of  the  geographical  unit  code,  except  zrtxere  It  is  X,  Indi¬ 
cating  a  city  with  population  over  1,500,000,  indicates  the  geographical 
regions  used  by  the  Bureau  of  the  Census. 

Cities  over  1,500,000. 
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Mlseellaneoua  Notes  on  the  Saapllng 

After  the  sanple  tias  selected  said  the  testing  con^leted, 
certain  minor  inaccuracies  in  the  san^ling  procedure,  due 
chiefly  to  misinfoxnation  at  the  time  the  sample  vas  selected, 
came  to  the  attention  of  the  project  staff.  While  it  is  be¬ 
lieved  that  these  inaccuracies  sure,  in  general,  too  trivial 
to  have  any  significant  effect  on  the  results  for  most  pur¬ 
poses,  they  are  listed  here  to  permit  the  reader  to  Judge 
for  himself. 

1.  The  Chicago  saddle  consisted  of  20  schools 
drawn  randomly  frcm  a  list  of  38  schools  which 
were  believed  to  constitute  the  total  group 

of  Chicago  secondary  schools.  It  was  later 
discovered  that  these  38  schools  were  all  aca¬ 
demic  and  technical  high  schools,  and  that  in 
addition,  there  were  nine  vocational,  high 
schools  which  had  not  appeared  on  the  list, 
and  which  therefore  had  no  opportunity  to  be 
represented  in  the  sample. 

2.  It  will  be  recalled  that  in  the  case  of  the 
public  schools,  most  of  the  custual  sao^le  se¬ 
lection  was  performed  by  an  electronic  com¬ 
puter.  An  anomaly  in  the  machine  set-up  had 
the  result  that  whatever  shhool  happened  to 
corresrond  to  the  very  last  caurd  in  the  sub¬ 
group  (of  13  or  20  or  50  ceurds)  had  only  half 
as  much  chance  of  being  selected  as  each  of 
the  other  schools  in  the  sub-group. 
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HOW  THE  TESTS  WERE  CONSTRUCTED 

The  decision  on  the  contents  of  the  battery  of  tests 
was  a  major  one  because  on  it  depended  how  eilmost  a 
million  pt^ll-Bchooldays  were  to  be  spent  (two  days  for 
each  of  almost  a  half-million  pupils). 

When  a  new  test  battery  is  to  be  put  together,  thejre 
are  two  reasonable  ways  of  doing  it.  One  is  to  select  a 
nvimber  of  tests  from  among  the  many  fine  ones  already 
a.vallable,  Including  both  commercially  published  and  non¬ 
commercial  tests.  The  other  is  to  develop  brand-new  tests. 
Very  serious  consideration  was  given  to  the  former  possibil¬ 
ity,  but  it  was  rejected  on  numerous  grounds.  The  chief 
reMon  was  that  tests  not  specifically  constructed  sy.th  the 
purposes  of  Project  Talent  in  mind  could  not  be  optimally 
satisfactory  for  meeting  those  purposes. 

To  be  optimally  satisfactory  a  test  battery  has  to  be 
designed  with  the  special  purposes  for  which  it  is  intended 
in  inlnd.  Each  test  must  make  its  own  unique  contribution  to 
those  purposes.  A  test,  however  good  it  may  be  when  used 
iJLone,  serves  no  useful  function  In  a  battery  If  It  accom¬ 
plishes  nothli:g  In  the  way  of  measurement  that  is  not  dcp- 
licated  in  effect  by  some  other-  test  or  combination  of  tests 
already  in  the  battery. 
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The  Problem  of  Test  Length 

Then  there  is  the  rather  troublesome  problem  of  test 
length.  A  ready-made  test  will  seldom  turn  out  to  be  the 
best  length  for  the  purpose  it  is  to  serve  in  the  battery. 
It  will  probably  come  as  no  surprise  to  the  reader  that  the 
test  must  be  long  enough  to  give  a  reasonably  accurate 
measure,  but  it  may  surprise  some  readers  to  learn  that  the 
use  of  tests  that  are  not  short  enough  is  also  a  hazard. 

If  it  is  important  to  measure  the  pupils '  ability  to  spell, 
and  if  it  is  all  right  to  have  l6  test  questions  devoted  to 
this  purpose  why  would  it  not  be  ten  times  as  good  to  have- 
160  items  on  spelling?  Surely  high  school  students  ought 
to  know  how  to  spell  more  than  16O  words  correctly.  Surely, 
then,  it  would  be  reasonable  to  test  spelling  ability  on  as 
many  as  I60  words.  Surely  the  results  obtained  from  160 
test  items  would  give  a  more  accurate  picture  of  the 
students '  spelling  ability  than  could  be  obtained  from  a 
mere  16  items.  Yes,  surely.'  But  if  I6  items  take  eight 
minutes  of  testing  time,  16O  items  would  eat  up  80  precious 
minutes.  And  the  72  extra  minutes  devoted  to  the  measure¬ 
ment  of  spelling  ability  would  mean  that  the  measurement  of 
several  other  important  kinds  of  aptitude  or  ability  would 
have  to  be  left  out  because  there  would  not  be  time  enough 
left  for  them.  Thus  it  is  just  as  important  to  have  the 


tests  short  enough  as  to  have  them  long  enough.  Tests 
that  are  to  be  used  for  survey  purposes  and  in  combination 
with  other  tests  to  provide  composite  scores  can  reason¬ 
ably  be  much  shorter  than  tests  which  are  to  be  used  for 

I  diagnosis  and  tests  whose  scores  are  to  be  used  individu- 

i 

'  silly.  For  purposes  of  prediction  a  large  number  of  fairly 


shozi:  tests  Is  generally  preferable  to  a  small  number  of 
longer  tests.  While  individual  scores  on  the  latter  may  be 
more  accurate  (or  to  use  the  technical  term,  more  ''reliable”) 
the  resultant  composites  will  probably  be  much  less  predic¬ 
tive.  Thus  one  major  advantage  of  the  decision  to  develop  a 
battery  from  scratch,  specifically  for  Project  Talent,  was 
that  each  test  could  be  made  as  long  or  as  short  as  seemed 
desirable. 

There  were  other  important  advantages,  too,  to  be  de¬ 
rived  from  having  new  tests,  designed  specially  for  Project 
Talent.  One  was  that  this  insured  that  none  of  the  tests 
would  ever  have  been  taken  before  by  any  of  the  students  in 
the  Project.  A  somewhat  related  advantage  lay  in  the  fact 
that  because  the  tests  were  specifically  and  solely  for  Pro¬ 
ject  Talent,  they  could  be  taken  out  of  circulation.  The 
tests  would  not  be  available  for  future  use,  except  for  studies 
related  directly  to  Project  Talent,  or  for  calibration  of 
other  standardized  tests  so  that  the  Project  Talent  results 
could  be  applied  to  those  tests. 

Once  the  decision  had  been  made  to  develop  a  special 
battery  of  tests  for  Project  Talent,  it  meant  that  a  decision 
had  also  been  made  to  ui^ertake  a  long  chain  of  intermediate 
steps.  This  chain  would  link  the  initial  planning  phase  to 
the  end-product,  the  final  test  battery.  The  general  pattern 
of  these  steps  is  outlined  below. 
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IV- 4 

A.  Planning  the  experimental  battery 

1.  Deterinining  the  broad  outlines  of  the  battery-r- 
the  general  form  it  would  take,  the  restric¬ 
tions  and  limitations  it  woiiLd  have  to  conform 
to,  the  functions  it  would  have  to  serve. 

2.  Review  of  past  research  and  experience,  to 
determine  what  kinds  of  tests  to  develop  for 
the  experimental  battery,  (it  is  desirable  to 
include  more  kinds  of  tests  in  the  experimental 
battery  than  it- .-.is.  expected  will  be  used  in  the 
final  battery. 

3.  Preparing  detailed  specifications  for  each  test. 

B.  Developing  the  tests  of  the  experimental  battery 

1.  Writing  the  items  and  organizing  the  tests  in 
accordance  with  the  specifications. 

2.  Putting  the  tests  together  into  an  experimental 
battery,  and  preparing  the  necessary  accessory 
materials . 

C.  Tryout  of  the  e:<perimental  battery 

1.  Arranging  for  tryout  in  a  suitable  group  of 
schools. 

2.  Actual  tryout. 

3.  Reporting  results  to  the  schools. 

D.  Analysis  .of  the  tryout  results 

1.  Initial  processing  of  the  results. 

2.  Scoring  of  the  tests. 

3.  Statistical  aiialysis  of  the  scores  to  decide 
which  tests  to  eliminate  from  the  battery. 

4.  Item  analysis;  in  other  words,  statistical 
analysis  of  the  results  for  each  test  Item. 


E.  Development  of  the  final  battery 

1.  Developn^nt  of  the  final  forms  of  the  tests 
that  are  to  be  retained  in  the  batter 

2.  Organization  of  the  tests  into  an  integrated 
battery  and  development  of  the  necessary 
accessory  materials. 

F.  "Dress  Rehearsal” 

1.  A  dress  rehearsal  of  the  final  battery  to  see 
that  nothing  has  been .overlooked. 

'2.  Making  whatever  minor  revisions  (in  directions 
and  timing)  seem  desirable. 

That  is  a  standard  pattern  for  developing  a  test 
battery,  and  it  is  the  pattern  that  was  followed  in  the  case 
of  Project  Talent.  Now  let's  go  back  to  the  beginning — 
planning  the  broad  outlines  of  the  battery. 

Planning  the  Battery 

V/hat  were  the  limitations  on  the  kinds  of  tests  to  be 
tried  out?  First  of  all,  there  was  a  time  limit;  the 
schools  in  the  try-out  group  could  not  be  expected  to  provide 
more  than  two  days  of  testing  time.  Secondly,  the  tests  had 
to  be  of  the  objective  type,  with  responses  mrked  on  an 
answer  sheet  that  could  be  scored  by  a  machine.  The  practi¬ 
cal  considerations  that  dictated  the-  use  of  objective  tests 
are  of  course  obvious,  especially  in  view  of  the  magnitude 
of  the  test-scoring  operation  even  under  the  best  of  clrciain- 
stances.  But  even  if  there  had  not  been  this  very  practical 
reason  for  requiring  objective  tests,  they  still  would 
probably  have  oeen  the  method  of  choice,  because  of  their 
greater  "reliability".  Thirdly,  most  of  the  tests  had  to 
ee  of  reasonably  well  established  types,  since  this  v;as  to 
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I’epresent  a  "state-of-the-art"  battery.  In  other  words 
the  development  of  the  battery  was  to  be  based  chiefly  on 
what  had  been  learned  over  the  years  about  the  art  of  test 
construction  and  about  what  various  kinds  of  tests  measvire 
and  predict,  rather  than  on  mere  specvilation.  Most  of  the 
tests  thus  had  to  measxire  abilities,  aptitudes,  and  kinds 
of  achievement  of  demonstrated  importeuice  and  predictive 
value.  While  tests  of  a  frankly  experimental  nature  were 
not  ruled  out,  they  could  certainly  represent  no  more  than^ 
a  very  small  fraction  of  the  final  battery. 

With  these  limitations  in  mind,  decisions  as  to  what 
tests  would  be  constructed  and  tried  out  could  be  made  on 
the  basis  of  a  review  of  past  research  concerning  what 
sorts  of  measures  are  useful  for  what  purposes*.  Recommen-  ■ 
dations  by  the  project’s  Test  Panel  were  of  course  given 
heavy  weight  in  making  the  decisions. 

As  has  already  been  mentioned,  in  developing  a  battery 
it  is  not  unusual  to  use  a  larger  nmber  of  tests  in  the 
experimental  form  than  it  is  expected  will  be  used  in  the 
final  battery.  This  'is  done  with  the  expectation  that 
some  tests  will  be  eliminated  on  the  basis  of  the  resultant 
data.  Project  Talent  followed  this  standard  practice,  con¬ 
structing  about  25  percent  more  tests  than  it  seemed  likely 
the  final  battery  woiAld  Include.  In  view  of  the  fact  that 
tests  would  be  discarded  from  the  battery  eventually,  the 
chief  concern  was  to  get  an  adequately  con5)rehenslve  battery 
for  tryout  purposes.  In  this  initial  stage  it  was  more  im¬ 
portant  to  avoid  errors  of  omissions  than  errors  of  commis¬ 
sion; _ 

'  *  The  historical  background  of  each  of  the  types  of  tests 
used  in  Project  Talent  is  presented  in  Chapter  VII. 
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It  was  decided  to  develop  experimental  forms  of  29 
tests,  plus  three  Inventories  (an  interest  inventory,  a 
student  activities  inventory,  and  a  student  information 
blank).  Most  of  the  rest  of  this  chapter  is  concerned 
with  the  tests  rather  than  with  the  three  inventories,  since 
construction  of  the  inventories  is  discussed  in  detail  in 
Chapter  VIII. 

The  29  experimental  tests  were  designed  to  measure 
aptitudes,  achievement  in  various  areas,  and  acquisition 
of  various  kinds  of  information.  The  names  of  the  tests 
are  listed  in  Table  IVfl.* 

Developing  the  Tests  of  the  Experimental  Battery 

Before  the  tests  themselves  could  be  written,  detailed 
specifications  had  to  be  prepared  for  them,  stating  not 
only  the  number  and  kind  of  items  but  also  the  reasons  for 
using  items  of  that  type,  suggestions  for  constructing  them, 
characteristics  the  items  should  have,  characteristics  they 
should  not  have,  and  other  details.  Underlying  all  this 
specification-witing  was  the  philosophy  that  on  the  quality 
of  the  specifications  depends  the  quality  of  the  final 
instruments.  This  philosophy  has  sometimes  been  expressed 
in  the  statement  that  most  of  the  time  allocated  to  develop¬ 
ing  a  test  sho\ild  be  devoted  to  preparation  of  the 
"rationale"  for  the  test — in  other  words,  determining  what 
to  measure  and  how  to  do  it.  If  this  is  done  thoroughly  and 
if  the  items  vTitten  conform  to  the  specifications  prepared, 
the  res-ultant  test  is  far  more  likely  to  be  a  good  one  than 

than  if  the  test  author  dived  headfirst  into  the  item^writing 

*  For  some  of  the  tests  the  name  used  in  the  final  battery 
differs  from  that  in  the  experimental  battery.  In  such  cas¬ 
es  Table  I  shows  both  test  names. 


phase  without  any  preliminary  research  or  planning. 

As  in  the  determination  of  the  number  of  e;q>erimental 
tests,  in  the  determination  of  the  length  of  the  Individual 
tests  it  Is  customary  to  be  somewhat  more  generous  than 
will  be  feasible  In  the  final  battery.  Project  Talent 
followed  this  customary  procedure,  Writing  mojre  iteas  than 
one  expects  to  use  in  the  final  form  permits  el,lminatlon  of 
some  Items  of  the  experimental  form  on  the  baels  of  the  try¬ 
out  data. 

With  very  few  exceptions  the  speclfipatlons  called  for 
tests  which  wore  not  strictly  parallel  tO  ehy  other  pub¬ 
lished  tests.  While  some  of  the  Itei?)  were  eomewhat 

similar  to  rather  widely  used  ones,  th*  tosts  Involved 
usually  differed  in  length,  (llstributlon  of  oontent,  and 
other  details. 

.The  exceptions  were  two  tests  already  published  which 
Involved  novel  elements  that  seemed  sufficiently  promising 
to  warrant  development  (with  the  authors'  permission,  of 
cotirse)  of  essentially  parallel  forms  for  the  Talent 
battery.  One  of  these  two  tests  was  the  Psl  Lambda  Test  (  ) 
developed  by  Dr.  John  B.  Carroll  and  Stanley  M.  Sapon.  This 
was  a  test  to  predict  aptitude  for  learning  foreign 
languages.  Three  of  the  tests  In  the  Talent  battery.  Dis¬ 
guised  Words,  Word  Functions  In  Sentences,  and  Memory  for 
Words,  are  based  closely  on  Subtests  3»  and  5>  respec¬ 
tively,  of  the  Psl  Lambda  Test.-'^* 

^  The  specifications  for  each  of  the  Project  Talent  tests 
and  the  details  as  to  the  extent  to  which  these  tests 
differ  from  previously  used  somewhat  similar  tests  are  dis¬ 
cussed  in  Chapter  VII- 

The  Psl  Lambda  Test  has  since  been  published  by  The 
Psychological  Corporation  under  the  title  "Modem  Language 
Aptitude  Test"  (  ). 


IV  -  9 


Tiie  olshef  testidn'  vhich  a  test  ,of '*tfie  lEalerrt  rBattery 
was  modeled  directly  was  the  Ingenuity  Test  of  the  Flanagan 
Aptitude  Classification  Test  (7  )  battery.  The  Creativity 
Test  of  the  Talent  Battery  is  essentially  a  parallel  form  of 
this  test. 


Although  the  final  forms  of  the  individual  tests  are 


discussed  in  considerable  detail  in  Chapter  VII,  a  brief 
description  of  each  experimental  test  is  presented  below. 


1. 


2. 


3. 


4. 


5. 


T. 


8. 


10. 


11. 


12. 


13. 


l4. 


Information  Test.  The  experimental  form  yielded  a 

total  score  ewxi  2k  subscores,  indicating  information 
in’ 24  separate  areas.  . 

Active  Vocabulary.  A  test. of  ability  to  find  (rather 
than  merely  to  choose  from  several  options)  the 
precise  word  fitting  a  given  definition. 


Effective  Expression 
English  Usage. 
Sentence  Structure. 
Punctuation. 
Capitalization . 
Spelling. 


These  six  subtests  comprise 
the  English  Test 


Reading  Comprehensiorf.  A  test  of  ability  to  comprehend 
written  materials  dealing  with  various  types  of  sub¬ 
ject  matter. 


Following  Directions .  A  test  of  ability  to  comprehend 
and  follow  simple  printed , directions . 

Disguised  Words.  A  test  of  ability  to  decipher 
words  >diose  spelling  is  distorted.  (This  is 
intended  to  measure  one  kind  of  aptitude 
involved  in  learning  a  foreign  language.) 


Word  Functions  in  Sentences.  A  test  of  sensitivity  to 
gramnatical  functions  of  words. 

Memory  for  Words.  A  test  of  ability  to  memorize 
foreign  words  corresponding  to  common  English 
words. 


Memory  for  Sentences.  A  test  of  one  kind  of  memory — 
the  ability  to  memorize  simple  sentences "and' 
recall  a  missing  word. 
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15.  Arithmetic  Computation.  A  test  of  speed  and  accuracy 

of  computation. 

16 .  Mathematics  I  (Arithmetic  Reasoning) .  A  test  of  ability 

to  do  the  kind  of  reasoning  required  to  solve 
arithmetic  problems. 

17.  Mathematics  II ! (introductory) •  Mathematics  (other  than 

the  kinds  measvired  by  Tests  15  and  16  above)  through 
-iiiie.  9th  grade  level. 

18.  Mathematics  III  (Advanced) .  College-preparatory 

mathematics  generally  taught  in  Grades  10-12. 

19.  Verbal  Reasoning.  A  test  of  ability  to  do  the  kind 

of  reasoning  involved  in  verbal  syllogisms. 

20.  Abstract  Reasoning.  A  non-verbal  test  of  one  kind 

of  abstract  reasoning  ability — the  ability  to  determine 
logical  relationships  among  the  elements  of  a  pattern 
of  diagrams . 

21.  Mechanical  Reasoning.  A  test  of  ability  to  visualize  the  t 

effects  of  everyday  physical  forces  and  principles 

(for  instance,  gravitation)  and  the  operation'  of  ^ 

basic  kinds  of  mechanisms  (for  instance,  gears, 

pulleys,  wheels,  springs,  levers) .  . 

22.  Visualization  in  Three  Dimensions.  A  test  of  ability 

to  visualize  how  a  two-dimensional  figure  would 
look  after  it  had  been  folded  to  make  a  three-  ’ 
dimensional  figure. 

23.  Visualization  in  Tiro  Dimensions.  A  test  of  ability  to 

visualize  how  diagrams  would  look  after  being 
turned  around  on  a  flat  surface,  in  constrast  to 
how  they  would  look  after  being  turned  over. 

24.  Scale  Reading.  A  test  of  ability  to  read  simple  dials 

and  scales  quickly  and  accurately. 

25.  Clerical  Checking.  A  test  of  speed  and  accuracy  of 

perception  in  a  simple  clerical  task,  involving 
comparison  of  names. 

26.  Table  Reading.  A  test  of  speed  and  accuracy  in  a  non- 

computational  clerical  task  involving  obtaining 
information  from  tables. 

27.  Ob.lect  Inspection.  A  test  of  speed  and  accuracy  in 

perception  of  form. 

28.  Creativity.  A  test  of  the  ability  to  find  ingenious 

solutions  to  a  variety  of  practiced  problems.  J 

29.  Preferences .  A  test  involving  a  decision-making  task. 

(This  instnanent  is  still  in  the  experimental  stage.) 


Because  only  two  days  of  testing  tine  vou3.d  be  available 
for  any  student  In  the  tryout,  and  because  it  was  desirable 
to  try  out  more  than  two  days’  worth  of  tests  and  test 
items,  two  parallel  forms  of  most  of  the  tests  were  develop¬ 
ed  (designated  Form  A  and  Form  B  respectively) .  Since  each 
student  was  to  be  given  only  one  of  these  two  forms,  it 
meant  that  more  items  could  be  tried  out  in  the  available 
txro  days. 

In  the  case  of  most  of  the  tests,  each  of  the  two 
experimental  forms  was  set  up  with  two  separate  equivalent 
halves,  to  be  administered  with  separate  time  limits.  The 
reasons  for  this  will  be  Immediately  apparent  to  specialists 
in  the  field  of  test  construction.  For  other  readers  it 
vdll  probably  suffice  at  this  point  to  say  that  the  reason 
was  that  it  was  necessary  to 
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be  able  to  find  out  in  the  experimental  tiTOUt  to  what 
extent  the  tests  were  successful  in  providing  meaningful 
scores  (as  opposed  to  scores  which  represented  random 
variation,  not  real  measurement).  This  is  discussed  in  a 
little  more  detail  later  in  this  chapter,  under  the  heading 
"Test  Reliability". 

The  items  developed  for  the  battery  were  all  brand 
new,  and  developed  specially  for  the  purpose  by  the  Project 
staff,  except  in  the  case  of  three  of  the  tests  (Scale  Read- 
ing.  Visualization  in  Three  Dimensions,  and  Object  Inspec* 
tlon,  for  which  the  United  States  Civil  Service  Commission 
very  kindly  provided  come  previously  unused  materials.* 
Experimental  Tryout  and  Data  Analysis 

The  experimental  battery  was  tried  out  in  11  widely 

scattered  high  ochools.  In  deciding  what  high  schools 

should  partic!*pav,e  in  this  tryout,  considerable  importance 

was  attached  to  the  desirability  of  having  a  wide  variety 

of  types  of  schools  represented.  By  design,  the  gr^up  of 

eleven  schools  finally  selected  for  this  tryout  Included 

schools  in  large  cities,  schools  in  smeLll  cities,  schools 

in  suburban  areas,  and  schools  in  rural  areas;  large 

schools,  medium-sized  schools,  and  s^iiall  schools;  schools 

in  the  Northeast,  schools  in  the  South,  and  schools  in  the 

Midwest.  All  students  in  Grades  9-12  in  these  schools  were 

tested.  This  was  a  total  of  nearly  6,000  students.  They 

each  filled  out  six  IBl  Answer  Sheets. 

*  For  the^ObJoct  Inspection  Test  and  the  Visualisation  in 
three  Dimensions  Test  the  Uhlted  States  Civil  Service  Con- 
mission  provided  some  of  the  items.  For  the  Scale  Beading 
Test  the  Commission  provided  diagrams  which  were  used  as  a 
basis  for  the  items.  The  Commission  also  contributed  the 
services  of  a  draftsman  in  preparing  some  of  the  diagrams 
for  the  Mechanical  Reasoning  Test. 


The  purposes  of  the  tryout  have  already  been  implied 

I 

but  perhaps  it  wovild  be  well  to  state  them  explicitly  at 
this  point,  so  that  the  reader  will  understand  what  was 
necessary  and  why.  The  tryout  had  two  main  purposes.  The 
first  was  to  decide  what  tests  were  to  be  in  the  fined 
battery  and  how  long  they  should  be.  In  other  words,  the 
basic  question  to  be  answered  was:  "How  cein  the  available 
time  best  be  apportioned  among  the  available  kinds  of  tests?" 
The  second  purpose  was  to  provide  a  basis  for  deciding  in  the 
case  of  those  tests  that  were  to  be  in  the  final  battery,  .. 
what  test  items  should  be  included.  The  reader  will  recall 

that  more  items  had  been  written  than  it  was  e:q)ected  would 

* 

be  used  in  a  final  form  of  the  test.  Therefore  many  items 
could  be  eliminated  on  the  basis  of  the  item  analysis. 

Some  of  the  items  that  were  to  be  retained  might  need  minor 
revisions;  the  item  enalysis  would  be  helpful  here  too. 

For  both  of  the  purposes  mentioned  above- -the  determination 
of  the  composition  of  the  final  battery  in  terms  of  the 
tests  in  it  and  determination  of  the  composition  of  each  of 
the  tests  in  terras  of  its  items — it  would  be  necessarj'  to 
know  the  test  scores.  They  would  be  needed  for  a  third 
purpose  too--so  that  test  results  could  be  reported  to  the 
schools  that  participated  in  the  tryout. 

The  procedure  for  the  initial  processing  of  the  results 
was  quite  novel.  Contrary  to  the  custonary  procedvnre, 
scoring  was  not  the  first  step.  Furthermore  when  the  score 
was  eventually  carried  out,  it  was  not  done  either  by  hand 
or  by  a  scoring  machine.  Instead  it  was  done  by  a  general 

f  ' 

I  purpose  electronic  computer.  Since  it  was  going  to  be 
!  necessary  to  have  information  not  only  about  each  student's. 


""  Al 
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score  on  each  of  the  tests  but  also  about  his  specific 

I 

'  response  to  each  test  item,  a  procerlure  was  used  for  getting 
all  of  a  student’s  responses  transferred  directly  from  his, 
answer  sheets  to  a  set  of  lEM  cards,  in  which  the  specific 
responses  were  represented  by  punched  holes.  A  special 
machine  developed  by  Mr,  Elmer  Hankes,  of  Testscor,  Inc., 
in  Minneapolis,  made  it  possible  to  treinsfer  these 

/ 

responses  directly  from  the  answer  sheets  to  the  cards 

without  any  human  intermediary  (except  to  set  up  the 

machine,  of  course).  Answer  sheets  and  blaiik  cards  were 

fed  into  the  jnachine;  answer  sheets  and  punched  cards 
came  out.  There  were  12  IIM  cards  for  each  student,  or  a 

total  of  almost  70,000  cards.  These  cards  were  then  fed 

through  a  different  machine,  the  IBM  70h  Computer,  which 

provided  "item  analysis"  data— the  Information  on  how  the 

students  responded  to  the  test  items— in  order  to  decide 

which  items  to  retain  and  which  items  to  eliminate.  At  the 

same  time  the  computer  actually  scored  the  tests,  obtaining 

a  total  of  53  scores  for  each  student. 

Some  of  the  readers  may  be  puzzled  by  the  concept  of 
item  ansJ-ysls.  They  may  ask,  "How  can  a  bunch  of  numbers 
tell  you  whether  your  test  items  are  any  good?"  The  answer 
is  that  actually  they  can't.  Item  euialysls  is  no  substitute 
for  Judgment  and  care  in  writing  the  items;  nothing  Is-s  But 
item  analysis  can  be  an  invaluable  supplement i  Let's  see 
how  it  works. 

Consider  the  following  test  item  (which  ve  hasten  to 
point  out  is  not  one  that  was  ever  really  used)  for  a 

I  general  information  test. 
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A  mixture  of  blue  emd  yellow  produces 

A.  orange, 

B.  red. 

C.  green. 

D.  white . 

E.  brown. 

^is  is  a  very  bad  test  item  because  it  is  ambituous;  it  base 
two  defensible  answers  instead  of  Just  one.  The  physicist 
knows  that  a  combination  of  blue  light  and  yellow  light 
produces  white;  the  artist  knows  that  mixing  blue  pigment 
with  yellow  pigment  produces  green  pigment.  Obviously,  then, 
either  C  or  D  is  a  defensible  answer.  Now  let  us  suppose, 
that  the  author  of  .the  item  does  not  know  much  about 
physical  science,  and  that  he  therefore  thinks  C  is  the  only 
answer.  When  he  prepares  the  key  for  the  test,  he  makes  C 
the  key  answer  for  that  item.  The  students  who  know  about 
neither  the  mixing  of  pigments  nor  the  mixing  of  colored 
light  rays  will  have  no  idea  of  the  euaswer.  They  may  guess 
any  of  the  choices  or  they  may  omit  the  item.  The  students 
who  know  about  pigment-mixing  but  not  about  light-mixing 
will  pick  C.  The  other  group  o:C  students  with  partial 
knowledge,  those  who  know  about  light-mixing  but  not  about 
color-mixing,  will  pick  D.  But  what  about  those  students 
who  are  best  informed?  They  are  the  ones  who  will  really 
be  puzzled  by  the  item  since  they  may  recognize  that  it  is 
ambiguoiu.  These  students  may  answer  C,  or  they  may  answer 
D,  but  they  are  likely  to  omit  the  item  entirely.  Nov 
saqppose  that  one  part  of  the  item  analysis  is  to  see  \diat 
kind  of  total  scores  on  the  test  the  stiidents  who  pick 
each  answer  get*  The  results  are  quite  likely  to  be 
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scBUfHhat  ae  foUom: 

!Ehe  studsnta  vho  4,  B,  or  E|  vill  have  lower  total 
scores  on  the  average  than  those  sho  pick  C  or  D;  hut 
those  who  omit  the  item  altogether  will  be  likely  to  have 
the  hif^est  scores  of  all.  These  vohLd  not  be  the  sort  of 
results  one  vould  expect  for  «  good  iten^  and  therefore 
they  should  serve  as  a  signal  that  scaiethlng  la  amiss.  A 
further  cl\ie  as  to  the  nature  of  the  difficulty  nle^  be 
provided  If,  as  seems  likely,  the  average  score  of  the 

J 

students  who  chose  D  were  about  as  hlc^  as  the  score  of 
those  who  picked  the  supposed  key  answer,  C.  If  further 
delving  revealed  exactly  what  the  trouble  Is,  the  Item 

f 

could  be  revised  and  salvaged.  For  instance  the  dlf- 
flcTiIty  could  be  obviated  ly  changing  the  Itan  as  foUows: 
Mixing  bltie  paint  with  yellow  paint  produces 

A.  Grange  paint. 

B.  red  paint. 

C.  green  paint. 

D.  white  paint. 

E.  brown  pednt. 

Then  the  Item  would  have  only  one  correct  answer,  C, 
(althou£^  option  D.  in  the  new  version  mle^  be  more  plsua. 
Ible,  and  therefore  better,  if  it  were  changed  to  violet). 

How  let  us  look  at  another  very  bad  test  itemr-or  at 
least  one  which  would  be  bad  for  most  purposes.  Suppose 
that  the  following  item  is  included  in  a  ninth-grade 
mathematics  test: 
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The  value  oflTis  closest  to 

A.  3‘ 1^1588 

B.  3-1^1589 

C.  3*l*»i591 

D.  3.141593 
B.  3*i41594 

{ 

This  Is  an  absurd  item.  -It  would  be  utterly  ridiculous  to 
expect  9th  grade  sttidenta  to  have  memorized  the  value  of  "If 
to  that  many  decimal  places.  As  a  matter  of  fact  it  would 
be  ridictlLous  to  .e:qpect  it  of  a  professional  mathematician. 
However,  if  this  item  did  get  into  a  mathematics  test  the 
results  for  the  item  analysis  would  probaUy ,  indicate  that 
good  and  bad  students  alike  weiNlf  apparently  guessing  xm 
the  item.  Srobably  about  the  same  number  of  students 
would  choose  each  option,  and  those  who  chose  option  D,  the 
key  answer,  would  not  have  any  hlc^er  scores  on  the  rest 
of  the  test  then  those  chose  A,  B,  C,  or  E.  This  item 
would  undoubtedly  be  thrown  out  of  the  test,  since  the  item 
analysis  data  would  make  it  immediately  apparent  that  it 
was  too  hard.  A  test  item  to  which  no  one  in  the  grovqp  for 
which  the  test  was  intended .  knows  the  answer  has  no  place 
in  the  tests. 

Likewise  item  analysis  results  can  point  out  items  that 
are  too  easy. 

Each  response  to  each  item  in  the  Talent  battery  was 
analysed  separately  for  the  lower  grades  of  hi|d^  school 
(grades  9  voA  10),  and  the  upper  grades  (11  and  12).  The 
infozmntlQn  obtained  for  each  cfpbion  of  .each  Item  included 
the  following: 

1.  The  percentage  of  those  students  who  reached 
the  item  that  select  the  option. 
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2.  The  avereige  score  of  the  students  'v^o 
selected  that  option. 

3.  A  value  called  the  "point  biserlal  corre¬ 
lation  coefficient"  -vdaich  Indicates  the 
degree  to  'vrtilch  students  'vdio  pick  the 
response  In  question  tend  to  have  higher 
(or  lover)  scores  than  students  who  pick 
other  responses  for  the  same  item. 

In  addition  the  following  information  was  obtained  for 
each  item: 

1.  The  percentage  of  students  tAo  reached  the 
item. 

2.  The  percentage  of  those  students  who 
reached  the  item  who  deliberately 
omitted  it. 

3.  Their  average  score  obtained  on  the  test  by  the 
students  who  deliberately  omitted  the  item. 

4.  The  corresponding  point  biserlel  corre¬ 
lation  coefficient. 

The  reason  for  obtaining  the  latter  three  values  was  so 
that  in  the  item  analysis  process,  deliberate  omission  of  an 
item  could  be  treated  as  what  it  really  was— a  form  of  response. 

The  percentage  of  students  reaching  each  item  was  deter¬ 
mined  for  an  entirely  different  reason— to  provide  a  basis 
for  deciding  on  time  limits  for  the  tests,  or  alterxiatively 
for  deciding  on  the  number  of  items  appropriate  for  a  given 
tine  limit. 

In  doing  an  Item  analysis  on  a  test  battery  as  large  as 


It 


this,  a  monumental  mass  of  data  is  the  outCCTie.  In  this 
instance  there  were  two  forms  of  a  29-test  battery, 
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Including  a  total  of  1^513  Items  in  all,  vlth  a  total  of 
almost  10,000  options;  this  meant  that  Item  analysis  data 
of  the  l^pe  Indicated  had  to  be  obtained  for  a  total  of 
approximately  12,000  options. 

The  Item  analysis  provides  the  basis  for  revising  the 
experimental  forms  of  the  tests  to  produce  final  forms.  If 
the  test  Is  to  be  Included  In  the  final  battery.  But  the 
Item  analysis  alone  does  not  mahe  a  very  good  basis  for 
the  decision  as  to  idiather  the  test  should  be  Included. 
Additional  data  are  needed  for  that  decision.  The  main 
problem  Is  one  of  efficient  use  of  the  Invaluable  testing 
time.  This  means  that  the  final  battery  should  consist 
of  tests  that  will  measure  as  many  different  things  as 
possible  and  will  overlap  each  other  as  little  as  possible. 

A  second  consideration,  closely  related  to  the  first.  Is 
whether  the  tests  are  adequately  reliable;  in  other  words, 
whether  two  parallel  forms  of  the  test  would  give  consistent 
results. 

At  this  point  still  another  electronic  computer 
entered  the  picture— the  IBM-709/  which  some'vdiat  resembles 
the  704  but  Is  bigger,  faster,  and  If  an  anthropomorphic 
description  were  to  be  \ised,  even  "smarter”. 

To  answer  the  question  about  test  reliability, 
statistical  values  called  "reliability  coefficients”  were 
cosq^uted.  Reliability  coefficients  represent  the  corre¬ 
lation*  between  parallel  forms  of  the  test.  This  correla¬ 
tion  coefficient  may  be  computed  directly  If  parallel  forms 
of  the  test  are  available;  otherwise  It  may  be  cosqputed  Indir¬ 
ectly  In  any  one  of  severed  possible  ways.  One  of  these 


*  Footnote  on  next  page 


ways,  which  involves  determining  the  relationship  between 
scores  on  two  halves  of  the  same  test,  the  halves  being 
separately  timed,  was  the  method  used  for  most  of  the  experi¬ 
mental  forms  of  the  Talent  tests. 

A  test  that  has  any  reliability  at  all  can  be  made  more 
reliable  by  adding  more  items.  Thus  the  reliability  coef¬ 
ficient  helps  determine  not  only  whether  a  test  should  be 
retained  but  how  many  items  it  should  have. 

Knowing  that  a  test  has  satisfactory  reliability  is  fine, 
but  it  is  still  not  enough.  To  decide  what  tests  to  pick  in 
order  to  minimize  overlap  and  maximize  coverage  it  is  neces¬ 
sary  to  know  about  the  interrelations  among  the  tests.  There¬ 
fore  inter correlations  were  computed  among  all  53  scores,  and 
these  values,  together  with  the  reliability  coefficients,  pro¬ 
vided  the  basis  for  subsequent  computation  of  indices  which 
provided  a  measure  of  the  extent  of  esich  test's  unique  con¬ 
tribution  to  the  battery.  Hie  details  of  this  subsequent 
computation  are  presented  in  Appendix  4A. 

Development  of  the  Final  Battery. 

On  the  basis  of  careful  consideration  of  cdl  available 
facts,  it  was  decided  to  eliminate  four  tests  that  were  in 


*  A  correlation  coefficient  is  a  number  representing  the 
degree  of  relationship  between  two  variables  (scores  on  two 
different  tests,  for  instance).  Correlation  coefficients  can 
have  any  value  between  +1  and  -1.  A  high  positive  correlation 
coefficient  indicates  that  high  scores  on  one  variable  tend 
to  be  acconvanied  by  high  scores  on  the  other,  and  low  scores 
on  one  variable  by  low  scores  on  the  other.  A  high  negative 
correlation  indicates  that  high  scores  on  one  variable  tend  to 
be  accoopanled  by  low  scores  on  the  other,  and  vice  versa.  A 
correlation  of  +1  represents  perfect  positive  jrelationship  and 
a  correlation  of  -1  represents  perfect  negative  relationship. 

A  correlation  of  zero  indicates  that  thiere  is  no  relationship 
between  scores  on  the  two  variables;  knowing  a  person's  scoz^ 
on  one  variable  gives  no  clue  as  to  what  his  score  is. on  the 
other. 
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the  experimental  battery,  make  minor  revisions  in  many  of 
the  others,  and  more  substantial  ^visions  in  a  few. 

It  vas  also  decided  to  allot  fiye  minutes  apiece  for 
each  of  two  veiy  brief  themes  to  be  written  by  the  students. 
These  themes  were'  to  be  on  the  topics,  "What  hi^  school 
means  to  me",  and  "'Wy  vibws  about  an  ideal  occupation". 

The  four  tests  that  were  eliminated  were: 

'Active  Vocabulary 
Verbal  Reasoning 
Scale  Reading 
PoUowing  Directions 

The  decision  to  eliminate  these  tests  vas  made  regret- 
f^ly,  bxrt  practical  considerations  dictated  it.  Although 
there  seemed  to  be  a  good  possibility  that  some  of  the 
four  tests  might  make  significant  unique  contributions  to 
the  battery,-  there,  was  a  limit  to  how  many  tests,  even 
comparatively  eihort  ones,  could  fit  into  the  available 
testing  time. 

The  composition  of  the  final  battery  is  summarized  in 
Table  IV-2. 

After  the  geneial  decisions  had  been -made  as  to  content 

of  the  final  battery,  one  major  decision  still  remained  to 

be  made  before  the  tests  could  be  revised,  put  together, 

and  organized  into  a  single  integrated  battery.  This  was 

the  question. of  how  the  various  parts  of  the  battery  were 

to  be  handled  . in  the  initial  data-processing  jdase,  sifter 

the  testing  had  been  coveted.  It  seems  advisable  to 

anticipate  Chapter  VI  at  this  point,  by  indicating  that  two 

different  kinds  of  machines— S:  Vscorlng  machine"  and  a 
"document  reader" -^-were  available  on  which  the  initial 
processing  could  be  done.  The  scoring  machine  wo\ild  be 
suitable  where  one  specific  response  to  each  option  was 
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designated  the  "right"  response  and  the  number  of  "right" 
responses  a  student  made  on  a  group  of  items,  in  other  words 
his  "score",  was  to  be  determined.  The  document  reader 
would  be  suitable  \diere  it  was  anticipated  that  Instead  of 
combining  items  into  scores  it  would  be  desirable  to  have  a 
record  of  the  specific  responses  to  individual  items,  so 
that  these  could  be  ana^ed  separately,  or  perhaps  combined 
In  a  variety  of  ways.  Which  way  a  particular  test  or  group 
of  items  would  be  handled  had  to  be  decided  long  before  the 
teats  were  given,  since  the  two  machines  required  different 
types  of  answer  sheets.  It  was  decided  to  fit  the  battery 
on  five  answer  sheets,  two  of  \diich  would  be  processed  on 
the  scoring  machine  and  the  remaining  three  on  the  document 
reader.  Document  reader  materials  would  inclvide  the 
Student  Information  Blank,  the  interest  Inventory, 

■t. 

and  basic  identification  data—student 's  name,  address, 
sex,  date  of  birth,  grade  in  school,  etc.,  while  the 
Student  Activities  Inventory  and  most  of  the  tests  (all 
of  them,  in  fact,  except  the  Information  Test)  would  be 
processed  on  the  scoring  machine.  That  left  the  Information 
Test  as  the  only  problem  area.  This  test  posed  a  problem 
because  some  of  the  items  fell  neatly  into  subject-matter 
areas  where  it  would  be  appropriate  to  obtain  scores 
immediately,  while  other  items  were  of  such  a  nature 
that  it  seemed  appropriate  to  score  them  individually. 

The  solution  was  a  simple  one.  The  test  was  split  into  two 
parts;  Part  I  went  on  one  of  the  answer  sheets  earmarked  for 
the  scoring  machine,  and  Part  II  went  on  another  answer  sheet, 
of  the  type  to  be  processed  by  the  document  reader. 


The  organization  of  the  final  battery  into  fo\ir  half¬ 
day  sessions,  the  tests  appearing  in  each  of  the  four  book¬ 
lets  and  on  each  of  the  five  ansver  sheets,  euid  the  time 
allowances  are  all  sianmarized  in  Table  IV- 3.  Of  the  five 
ansver  sheets,  designated  A,  Bl,  B2,  C,  and  Record  Form  Z, 
Ansver  Sheets  A  and  C  are  the  tvo  designed  for  the  Scoring 
Machine,  vhile  Ansver  Sheets  Bl  and  B2  and  Record  Form  Z  are 
the  sheets  for  the  Document  Reader.  For  the  leaefit  of 
those  readers  vho  vould  like  to  see  vdiat  the  aoisver  sheets 
look  like.  Figures  1-6  shov  both  sides  of  Ansver  Sheet  C, 
Ansver  Sheet  B2,  and  Record  Form  Z.  Note  the  ‘spsKse  allowed 
on  both  sides  of  Answer  Sheet  B2  for  writing  one  of  the 
five-minute  themes  (Question  395 )• 

Dress  RehearseLl 

The  very  last  step  before  freezing  the  battery  into  its 
final  form  was  a  full-scale  "dress  rehearsal",  which  took 
place  in  February  i960.  The  "stage"  was  Preston  High  School, 
in  Preston,  Maryland,  where  the  full  two  days  rf  the  battery 
were  administered.  Since  things  went  smoothly..,  only  a  few 
minor  changes  in  time  limits  were  necessary,  bei’ore  the 
presses  could  start  rolling  to  turn  out  materiela  for  test¬ 
ing  a  half -million  students. 
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Answer  Sheet  B2  (Side  1) 


PARH  1  cent. 

A  B  C  D  E  F 

A  B  C  D  E  F 

A  e  C  D  C  F 

8400000 

148  oooooo 

SIOOOOOO 

8800000 

146  000000 

82000000 

8600000 

147  000000 

83000000 

8700000 

148  000000 

0>” 

84000000 

8800000 

149  000000 

1 « 

88000000 

8900000 

180  oooooo 

86000000 

9000000 

181  oooooo 

0  c 

87000000 

91000000 

182  000000 

'5*2 

88000000 

92000000 

183  000000 

e  £ 

>  c 

89000000 

93000000 

184  000000 

2- 

80000000 

94000000 

188  000000 

61000000 

98000000 

186  000000 

o  £ 

62000000 

98000000 

187  000000 

t  s 

63000000 

97  000000 

188  000000 

640000  JO 

98000000 

189  000000 

•z  .2* 

6800000 

99000000 

160  oooooo 

a-'" 

6600000 

lOOOOOOOO 

161  oooooo 

0  = 

u< 

6700000 

lOiOOOOOO 

162  000000 

6800000 

102  0OOOOO 

163  000000 

6900000 

103000000 

164  000000 

700OOOO 

104000000 

168  000000 

7100000 

1080OOOOO 

166  000000 

JL 

7200000 

1060OOOOO 

167  000000 

ki 

0 

7300000 

1070OOOOO 

168  000000 

7400000 

108000000 

169  000000 

7800000 

109OOOOOO 

170  oooooo 

c 

7600000 

IIOOOOOOO 

171  oooooo 

0 

7700000 

IIIOOOOOO 

172  000000 

*«5 

7800000 

112000000 

173  000000 

0 

7900000 

113000000 

174000000 

E 

aoooooo 

114000000 

178000000 

la 

A 

8100000 

118000000 

A  B  C  D  E  F 

8200000 

116000000 

,  176000000 

c 

8300000 

117000000 

177  000000 

A  e  C  0  C  F 

118000000 

178000000 

c 

119000000 

179  000000 

0) 

120OOOOOO 

180000000 

-0 

121000000 

181  oooooo 

122000000 

182  000000 

Si 

123000000 

183  000000 

124000000 

184  000000 

128000000 

188000000 

126000000 

186  000000 

127000000 

187  000000 

s 

128000000 

1880000 

—  129000000 

189  00000 

PARf  tl  A  B  C  D  E  F 

190OOOO0O 

cc 

1300OOOOO 

191  ooooo 

0 

1A 

131  oooo 

192  000000 

o 

132000000 

193000000 

w 

at 

13300000 

194  000000 

< 

134000000 

198  0000 

& 

s  < 

138000000 

196  000000 

ly 

13600000 

197  000000 

(9 

>■  at 

13700000 

198  000000 

9 

<  < 

138000000 

199  000000 

A 

at 

139000000 

20OOOOOO 

H 

140OOOOOO 

201  oooooo 

X 

141  oooooo 

202  oooooo 

III 

0  •- 

142000000 

203  oooooo 

H 

*  z 

143000000 

204  oooooo 

lU  “ 

144  000000 

208  oooooo 

Hi 

X 

A  B  C  D  E  F 

A  B  C  D  E  F 

z 

< 

% 

ly 

- ^ 

- 

Sik  C  Z  - 

®0©©©©©@©@r 

og  ©©©©©©©©©©[ 
2S  @0©©©©©©©© 
©0©©©©©©©®!^ 
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PLEASE  . . .  keep  your  answer  sheet  clean.  ^ 
Do  not  fold  it  or  bend  the  corners. 


/ 


II  §1 


PLEASE... keep  your  answer  sheet  clean. 
Do  not  fold  it  or  bend  the  corners. 


;  PART  III 

ABCOEFCHIJKL 

aoeoooooooooooo 

207OOOOOOOOOOO0 

aoaoooooooooooo 
aoeoooooooooooo 
210  000000000000 
211000000000000 
212  000000000000 

PART  IV 

ABCDEFGHI  JKL 

2130000000000 
2140000000000 
2180000000000 
2160000000000 
21700000000 
21800000000000 
210  00000000000 

220  0OOOOOOOOO 

221  oooooooooooo 

222  000000000000 
223000000000000 
224  000000000000 
228000000000000 
226000000000000 
2270000000000 
228000000000000 
2290000000000 
230000000000000 

K  231000000000000 
232000000000000 
2  233000000000000 
234000000000000 
2  238000000000000 
5  236000000000000 
^  237000000000 
>  238000000000000 
2  23900000000000 
"  24000000000000 

A  B  C  D  E  F  C  H  I  i  K  I 
n  PART  V  A  D  C  D  C  F 

°  '^^'*^''241000000 

5  242000000 

^  243000000 

K  244000000 

«  245000000 

»  <  246000000 

^  UI  247000000 

0  “  248  0  0 

z  <  24900 

o  ^  28000 

a  -  28100 

*  25200 

*■  25300 

z  254  0  0 

-  255  0  0 

25600 
^  257  00 

K  258  0  0 

<  289  00 

s  260OO 

26100 
>  262  00 

*  26300 

2  26400 

W  26500 

266  00 
O  26700 

Z  26800 

26900 
W  270OO 

<  27100 

,  272  0  0 


MNOPQBSTUVWXfZ 

206  OOOOO 

207  00000000000000a07  000000000 

208  OOOOO 

209  0000000000000020900000000 

210  oooooooooo 

211  000000000000002110000000000 
212  00000000000000212  0000000000 


A  B  C  D  E  F 

273  00 

274  00 
278  00 

276  00 

277  OO 

278  00 

279  00 

280  00 

281  OO 

282  00 

283  00 

284  000000 
288  000000 
286  000000 

287  000000 

288  000000 
289  000000 
290000000 

291  oooooo 

292  000000 

293  000000 
294000000 
295  00 

_ 296  0000 

PART  VI  A  B  C  0  E  F 

297  00000 
29800000 
299  00000 
30000000 

301  OOOOO 

302  0000 

303  OOOOO 

304  oooooo 

305  OOO 

306  00 

307  oooooo 
308000000 
309  oooooo 
310000000 

311  oooooo 
312000000 
313000000 
314000000 
318000000 
316000000 
317000000 
318000000 
319000000 
320000000 
321000000 
322000000 
323000000 
324000000 
328000000 
326000000 
327  000000 
328000000 
329000000 
330OOOQ00 
331000000 
332000000 
33300000 

A  B  C  D  E  F 


A  B  C  D  E  F 

33400000 

33800000 

33600000 

337000000 

338000000 

33900000 

340OOOOOO 

341000000 

342000000 

343000000 

344000000 

348000000 

346000000 

347000000 

348000000 

349000000 

380000000 

381000000 

382000000 

383000000 

384000000 

388000000 

386000000 

387000000 

388000000 

389000000 

360OOOO0O 

361000000 

362000000 

36300000 

364000000 

368000000 

366000000 

367000000 

368000000 

369000000 

370OOOO0 

37100000 

372000000 

373000000 

374000000 


PART  VII 


A  B  C  D  E  F 

378000000 

376000000 

377  000000 

378000000 

379000000 

380OOOOOO 

381000000 

382000000 

383000000 

384000000 

388000000 

386000000 

387000000 

388000000 

389000000 

380OOOOOO 

39100000 

39200000 

393000000 

394000000 

A  B  C  0  £  F 


ANSWER  Sheet  B2  (Side  2) 


ANSWER  SHEET  C  (SIDE  1)  •  TALENT  TESTING  PROGRAM 


lOOOOOO 

1 1  ooooo 
1200000 
1300000 
1400000 
1500000 
1600000 
17  00000 
1800000 


1900000 
2000000 
2100000 
2200000 
23  OOOOO 
2400000 
28  OOOOO 

26  OOOOO 

27  OOOOO 


2800000 
2900000 
3000000 
3100000 
3200000 
3300000 
3400000 
38  OOOOO 
3600000 


3700000 

3800000 

3900000 

4000000 

4100000 

4200000 

4300000 

4400000 

4800000 


8800000 

8600000 

8700000 

8800000 

8900000 

6000000 

6100000 

6200000 

6300000 


Arithmetic 

Computation 


A  Q  C  0  £ 

SI  oooo« 


A  6  e  n  r 

1 ooooo 
200000 
300000 
400000 
600000 
600000 

7  OOOOO 

8  OOOOO 

9  OOOOO 


A  e  c  0  e 
4600000 
4700000 
4800000 
4900000 
8000000 
81  OOOOO 
8200000 
8300000 
8400000 


A  H  C  0  E 

6400000 

6800000 

6600000 

6700000 

6800000 

6900000 

7000000 

7100000 

7200000 


^  Memory 
for  Words 


ABODE  ABODE  ABODE  ABODE  ABODE  ABODE  ABODE  ABODE 

1  ooooo  4  00000  7  00000  lOOOOOO  13O0OOO  16  00000  19  00000  2200000 

2  00000  8  00000  8  00000  11  OOOOO  14  00000  17  00000  20  00000  2300000 

300000  6  00000  9  00000  12  00000  18  00000  18  00000  2100000  2400000 


Memory  for 
Sontencos 

A  E  0  L  T 

SI  oo»oo 


S2< 


I  L  I'  R 

►oooo 


A  E  0  T  X 

1 OOOOO 

A  E  N  SR 
200000 


1 ooooo 
200000 


A  L  0  R  u 

300000 

A  H  >  L  U 

400000 

— rrm- 

300000 

400000 


AGLOW 

5  OOOOO 

T  A  I  R  a 
600000 

500000 

6  OOOOO 


A  E  I  L  R 

7  ooooo 

A  H  I  L  0 
800000 

'J'"  S  !  6'  E 
700000 
800000 


AEIOT  AETUW  ELOPR  ElOL  T 

9  00000  11  OOOOO  1300000  1500000 


A  E  P  R  7 

lOOOOOO 

—  rri'  ii’7~ 

9  OOOOO 

1  Ooooo 

2900000 

3000000 

3100000 

4900000 

5000000 


A  E  I  L  0 
12  00000 


I  0  P  R  T 

1400000 


R  I  A  X  W 
1600000 


1 1  oooo 
120000 


Mothematics 

Parti 


A  6  C  D 

130000 

140000 


A  e  c  D  E 
IS  OOOOO 
1600000 


Mcithematici 
Purl  II 


A  e  C  D  E  A  e  C  0  E  A  B  C  D  E  A  B  C  D  E 

17  00000  2000000  2300000  2600000 
1800000  2100000  2400000  2700000 
19  00000  2200000  2800000  2800000 


ABODE 

3200000 

3300000 

3400000 


A  B  C  D  E 

3500000 

3600000 

3700000 


ABODE 

3800000 

3900000 

4000000 


Malhemalles 
Pari  III 


A  B  C  0  E  ABODE  ABODE  A  B  C  D  E 

4100000  4300000  4500000  4700000 
4200000  4400000  4600000  4800000 


ABODE 

5100000 

5200000 


ABODE 

5300000 

8400000 


a  English 
Pari  I 


SI  ' 


BODE 

»oooo 


ABODE 

1 OOOOO 
20000 
300000 


ABODE 
4000 
5  OOOOO 
60000 


ABODE 

7  OOOOO 
800000 
90000 


ABODE 

lOOOOOO 

11  oooo 
120000 


ABODE 

1300000 

1400000 

150000 


ABODE 

1600000 

1700000 

180000 


ABODE 

1900000 

200000 

2100000 


ABODE 

220000 

2300000 

240000 

2500000 


English 
Pori  II 


ABODE 

260000 


ABOD  ABC  ABC 

29000  32000  35000 

27  000  300000  33000  36000 

2800000  31000  34000  37000 


English 

Part  III 

Section  a 

A  e  C  D  £ 

A  B  C  0  E 

4400000 

ABODE 

510000 

0  1  2 
56000 

0  1  2 
63000 

3800000 

45000 

5200000 

57000 

64000 

ABODE 

390000 

4600000 

5300000 

58000 

SlOfBO 

400000 

4700000 

Section  b 

59000 

S20000» 

41000 

4800000 

0  1  2 

60000 

4200000 

4900000 

54000 

61000 

43000 

5000000 

55000 

62000 

English 

A  B  C  D  E 

6500000 

ABODE 

69  00000 

ABODE 

73  OOOOO 

ABODE 

7700000 

Part  IV 

6600000 

7000000 

74  OOOOO 

7800000 

SI  oo»oo 

6700000 

71  ooooo 

75  OOOOO 

79  OOOOO 

S20000* 

6800000 

72  00000 

76  OOOOO 

8000000 

English 

c  s 

810  O 

c  s 

880  O 

c  s 

950  O 

c  s 

1020  O 

c 

1090 

S 

O 

Part  V 

820  O 

890  O 

960  O 

1030  O 

llOO 

O 

830 

840 

850 

860 

870 


O 

O 

O 

O 

O 


90  0 

91  O 
920 
930 
940 


O 

o 

o 

o 

o 


97  0 
980 
990 
100  O  O 
101 0  O 


O 

O 

O 


1040 

1050 

1060 

1070 

1080 


O 

O 

O 

O 

O 


AbtIracI 

Raatening 

ABODE 

SI  oooo» 

S200004R 

S300«00 


ABODE  ABODE  ABODE  ABODE 

1 OOOOO  800000  900000  1300000 

200000  600000  lOOOOOO  1400000 

300000  700000  1 1  OOOOO  1500000 

400000  800000  1200000 


Copyright,  1960,  by  University  of  Pittsburgh 
Printed  in  the  U.S.A. 


©©®©@®®©©®| 

©©@©@@@©@@1 

®©©©©®®©©@ 

®©©©@©®©@@‘ 


©@@@@©©©@©©@@@@@©@@©©@@(1)© 

@@@@@@©@€©©@©@@@©@@@©@@(1x8© 

©@®<3K8)®©©@©©@0®<i)@©@®©©@@(i)@€^ 

©@®®@®©®®©©@©®@©©@®@©@@®©©@ 

®@®®@@©<gKg)©©@@®@®®@@@©@©<^^ 

®@®®®®©©@©©®©®@@©@©@©@@(I)@©© 

©@®®@®©®@©©@©®@@©@®@©(§)@®@@@ 


Id 

Z 

< 

Z 

P- 

in 

< 

j 


nvi.UNi  3naoiw! 


TVUiNI  iSMIJ 


PLEASE  .  .  . 

Keep  your  onswer  sheet 
as  clean  as  possible. 
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ANSWER  SHEET  C  (SIDE  2) 


Mtchonical 

Reasoning 

ABC 

*  51  *00 

h. 


Diigulod 

Wgrcfi 


A  B  C  D  E 
51  0»000 


A  B  C  [I 

lOOOO 

20000 

30000 

4000 


A  B  C  U  E 


A  B  C  C  E 


600000  IIOOOOO  16  0000 

7  000  120000  17  0000 

8000  13000  18  00000 

900000  14000  19  000 


5000  lOOOO  150000  20  0000 


A  S  C  D  G 

1 ooooo 
200000 
300000 
400000 
500000 

6  OOOOO 

7  OOOOO 
800000 


A  B  C  D  G 
900000 

10  OOOOO 

1 1  ooooo 
1200000 
1300000 
1400000 
1500000 
16  00000 


A  6  C  0  E 

1 7  OOOOO 
1800000 
1900000 

20  iboooo 

21  OOOOO 

22  OOOOO 

23  OOOCio 

24  ooooo 


A  B  C  D  G 

25  ooooo 

26  ooooo 

27  OOOOO 

28  OOOOO 

29  OOOOO 

30  OOOOO 


Creativity 


A  B  C  0  E 

51  oo«oo 


A  B  C  D  E 

1 OOOOO 
200000 
300000 
400000 
5  OOOOO 


A  B  C  D  G 
600000 
7  OOOOO 
800000 
900000 
10  OOOOO 


A  B  C  0  G 

1 1 OOOOO 
1200000 
1300000 

14  00000 

15  00000 


ABC  0  E 

1600000 

1700000 

1800000 

1900000 

2000000 


Clerical 

Checking 


S  D 

51  O  • 


lO 

O 

150 

O 

290 

O 

430 

O 

570 

O 

20 

O 

160 

o 

300 

O 

440 

O 

580 

O 

30 

O 

170 

o 

310 

O 

450 

O 

590 

O 

40 

O 

180 

o 

320 

o 

460 

O 

600 

O 

50 

O 

190 

o 

330 

o 

470 

O 

610 

O 

60 

O 

200 

o 

340 

o 

480 

O 

620' 

o 

70 

O 

210 

o 

350 

o 

490 

O 

630 

o 

80 

o 

220 

o 

360 

o 

500 

O 

640 

o 

90 

o 

230 

o 

370 

o 

510 

O 

650 

o 

lOO 

o 

240 

o 

380 

o 

520 

O 

660 

o 

no 

o 

250 

o 

390 

o 

530 

O 

67  0 

o 

120 

o 

260 

o 

400 

o 

540 

O 

680 

o 

130 

o 

270 

o 

410 

o 

55  0 

O 

69  0 

o 

140 

o 

280 

o 

420 

o 

560 

O 

700 

o 

S  D 

710  O 
72  0  O 


S  D 

730  O 
740  O 


Vitual'i'n  in 
2  Dimensienc 

«  A  B  C  0  E 
51  000«0 


^  Reading 

Comprehension 


ABCOE  ABITDE  ABCDG  ABC  D  E  ABC  DE  ABCDE  AB  C^  D  t  A  B  C  D  E 

1  OOOOO  400000  700000  10  OOOOO  1300000  1600000  1900000  22000Q0 

200000  500000  800000  IIOOOOO  1400000  1700000  2000000  2300000 

300000  600000  900000  1200000  1500000  1800000  2100000  2400000 


A  B  C  U  E 

1 OOOOO 
2  OOOOO 
300000 
400000 

5  OOOOO 

6  OOOOO 


7  OOOOO 
800000 
9  OOOOO 
10  OOOOO 
1 1 OOOOO 
12  00000 


1300000 
1400000 
1500000 
1600000 
17  00000 
1800000 


D  E 

1900000 
2000000 
2100000 
22  OOOOO 
2300000 
24  OOOOO 


ABCOE 

2500000 

2600000 

2700000 

2800000 

2900000 

3000000 


3100000 

3200000 

3300000 

3400000 

3500000 

3600000 


ABCDE 

3700000 

3800000 

3900000 

4000000 

4100000 

4200000 


ABCDE 

4300000 

4400000 

4500000 

4600000 

4700000 

4800000 


Visual'i'n  in 

3  Dimensians  ABODE  ABCDE  ABCDE  abode  a. bode  ABCDE  ABCDE  ABCDE 

I  B  c  D  E  1  ooooo  300000  500000  700000  900000  IIOOOOO  1300000  1500000 

510000*  200000  400000  600000  800000  lOOOOOO  1200000  1400000  1600000 


Ward  Functions  ABCDE  ABCDE  abcde  abcde  abcde  abcde  abcde  ab.cde 

ABCDE  1  OOOOO  400000  700000  IQOOOOO  1300000  1600000  1900000  2200000 

5100*00  2  00000  500000  800000  IIOOOOO  1400000  1700000  2000000  2300000 

5200*00  300000  600000  900000  1200000  1500000  1800000  2100000  2400000 


Table 

Reading 


A  B  C  [i  E 

51  00*00 
520000* 


*  Object 
Inspection 

ABCDE 
51  00*00 


ABCDE 

1  OOOOO 
200000 
300000 
400000 
500000 
600000 
700000 
800000 
9000CD0 


1 OOOOO 

2  OOOOO 

3  OOOOO 

4  OOOOO 

5  OOOOO 


IQOOOOO 
1 1  OOOOO 
1200000 
1300000 
1400000 
1500000 
1600000 
1700000 
1800000 


600000 

700000 

800000 

900000 

lOOOOOO 


1900000 
2000000 
2100000 
2200000 
2300000 
2400000 
2500000 
2600000 
27  OOOOO 


1 1  OOOOO 
1200000 
1300000 
1400000 
1500000 


2800000 
2900000 
3000000 
3100000 
3200000 
3300000 
3400000 
35  OOOOO 
36000CD0 


1600000 
17  00000 
1800000 
1900000 
20  OOOOO 


3700000 

3800000 

3900000 

tfOOOOOO 

4100000 

4200000 

4300000 

44000CD0 

480CXDCD0 


ABODE 

2100000 

2200000 

2300000 

2400000 

2500000 


ABCDE 

4600000 

4700000 

4800000 

4900000 

5000000 

5100000 

5200000 

5300000 

5400000 


B  C  D  E 
2600000 
27  OOOOO 
2800000 
2900000 
3000000 


ABCDE 

5500000 

5600000 

5700000 

3800000 

5900000 

6000000 

6100000 

620CD000 

6300000 


,,  B  C  D  E 

31  OOOOO 

32  OOOOO 

33  OOOOO 

34  OOOOO 

35  OOOOO 


ABODE 

6400000 

6500000 

6600000 

6700000 

6800000 

6900000 

7000000 

7100000 

7200000 

3600000 

37  OOOOO 

38  OOOOO 
3900000 
4000000 
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CHAFFER  V 

HOW  ITBE  TBSITS  WERE  CIVEN 

At  9:00  a.m^  on  March  1,  i960,  all  225  students 
of  the  Riverside  Indian  School  In  Anadarlso,  Oklalioina 
vere  seated  In  their  homerooms.  Today,  they  were  to 
take  some  tests,  but  no  one  had  studied.'  Ful^ennpr^, 
all  of  the  nine  teachers  knew  no  one  had  studied.  Rb 
preparation  was  possible  for  the  Talent  tests,  since 
they  covered  slLI  school  subjects — euid  some  not  tau^t 
In  school.  Insteeid  of  the  students  studying,  the 
teachers  had  prepared  for  the  test  I  They  had  practi¬ 
cally  "gone  to  school"  Just  to  learn  how  to  give  these 
testa.  They  had  attended  lectures,  conferences,  and 
read  a  book  of  Instructions  Just  to  get  ready  for  this 
day. 
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Oh  each  teacher's  desk  vere  the  test  hooks  for  that 
morning.  But,  In  addition,  there  were  Answer  Sheets  A, 
Record  Forms  Z,  Student  Identification  Cards,  a  Test 
Record  Form,  extra  pencils,  a  stopwatch,  and,  of  course 
the  Instruction  hook. 

Written  on  each  hlackhoard  was: 


DO  HOT  TURN  OR  OPS®  YOUR  TEST 


BOOKLETS  URTIL  TOLD  TO  DO  SO. 

Test  Booklets  A  were  passed  out,  then  Answer  Sheets 
A,  and  finally  Student  Identification  Cards . 

When  all  the  materials  had  heen  passed  out,  each 

teacher  read  this  statement: 

"Starting  today  you  will  he  taking 
part  In  a  nation-wide  study  of  hl^ 
school  talents.  As  a  student  In 
one  of  the  hl^  schools  selected, 
you  are  part  of  a  group  that  repre¬ 
sents  ALL  hl^  schools  throu^out 
the  country.  Only  ORE  In  every 
twenty  hl^  schools  will  take  pEurb 
In  this  project. 

"One  of  the  things  this  study 
Is  trying  to  find  out  Is  what  your 
best  talents  are.'  The  tests  will 
cover  a  wide  range  of  topics.  Some 
of  the  questions  will  he  easy  and 
some  will  he  hard,  hut  don't  he  dis¬ 
couraged  hy  the  htud  ones,  because 
no  one  Is  expected  to  he  equally  good 
In  all  areas.  Just  work  as  quickly 
and  accurately  as  you  can  and  try  your 
very  best. 

"Our  school  will  receive  a  sunnary 
of  yoMT  test  results.  This  Information 
can  he  \iseful  to  your  teachers,  counselors, 
and  advisors  In  helping  you  to  make  plans 
for  aifter  hlj^  school." 

For  the  next  half  hour,  teachers  read  Instructions  on 

■  „  w  a:.'  '.’t;  I’ov: .  '0]io 

how  to  mark  answer  sheets  and  record  forms.  The  stiuients 
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had  to  do  more  than  just  write  their  names.  Since  the 
euisvsT  sheets  were  devised  so  that  they  could  be  "wad” 
by  a  machine,  students  "wrote”  their  names  by  blackening 
in  spaces  to  spell  out  their  names,  school  code,  grade, 
sex,  and  testing  number.  Here  is  what  this  part  of  the 
answer  sheet  looked  like  before  it  was  filled  in: 


Later  on,  the  scoring  machine  wo\ild  be  able  to  "read"  the 
information  about  each  student  while  scoring  his  euiswer 
sheet  I 

At  about  9:30  a.m.,  the  students  had  been  read  the 
Instructions  for  the  first  test ^  the  Information  Test. 

They  opened  their  test  books  and  began  answering  questions 
on  literature,  mechanics,  mathematics,  food,  physics,  music, 
electricity,  biology,  chemistry,  hoos  economics,  geography, 
zoology,  social  studies,  farming,  space  travel,  spOrts,and 
many  other  topics. 

The  students  felt  that  this  war  a  good  test  on  which 
to  start.  If  a  boy  didn't  know  much  about  cooking,  -he -sur^y 


could  imswer  the  questions  about  fishing  or  basebeill  or 
monkey  wrenches.  Everyone  could  answer  some  questions  on 
some  subject! 

For  two  days,  the  225  students  of  the  Riverside  Indian 
School  answered  questions  by  blackening  in  spaces  on  answer 
sheets.  For  each  question,  the  student  chose  an  answer  from 
among  several  which  were  offered,  and  then  blackened  in  that 
space  on  an  answer  sheet.  Part  of  an  answer  sheet  is  shown 
below: 


inglith 

S«c(ian  0 

A  :  {,  t 

A  d  L'  .. 

0  :  t 

Part  III 

44  00000 

Si  0000 

56000'' 

63000 

3800000 

45000- 

52  00000 

37  000 

64000' 

39  0000 

4600000 

5300000 

58000' 

sio«»o 

400000 

4700000 

Section  b 

59000'' 

sjooooei 

41  000 

4800000 

0  ;  7 

60000'' 

4a,ooc'Oo 

49CO'OOD 

54000' 

61000' 

/  0  •• 

3000000 

5-3000 

62000 

At  the  end  of  the  two  days,  each  student  had  been  asked 
nearly  2000  questions--  not  only  what  he  knew,  but 
what  he  was  interested  in,  what  kind  of  a  person  he  Vras, 
what  his  plans  were,  and  many  other  questions.  Each 
student  probably  answered  more  questions  and  told  more  about 
himself  than  he  ever  had  before,  or  ever  would  again! 

At  3:57  P»ni.  on  March  2,  the  testing  was  over.  America’s 
first  children  at  the  Riverside  Indian  School  were  the  first 

I 

\ 

to.  finish  Project  Talent  with  one  hundred  percent  of  the 
students  taking  part. 

The  scene  above  took  place  in  1356  other  schools  from 
Mad&wska,  Maine  to  Walluku,  Hawaii  in  the  spring  of  i960. 
Althou^  not  every  school  finished  with  100^  participation, 
schools  all  over  the  country  reported  that  attendance  was 
higher  on  the  testing  days.  Students  who  took  all  of  the 
tests  became  members  of  the  Project.  They  were  issued 


i 
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neoibersMp  cards,  each  with  his  name  and  Individual  testing 
n;sBber.  Years  from  now,  their  card  will  still  Identify 
them  as  having  participated  In  this  history  making  project. 
The  People  Who  Arrangesd  to  Give  the  Tests 

In  order  to  arrange  a  study  of  the  hl£^  school  students 
of  our  country,  thousands  of  people  had  to  cooperate.  Over 
18,000  teachers  actually  gave  the  tests  In  the  schools. 

Before  they  began,  they  spent  many  hours  of  their  personal 
time  stiidylng  over  the  procedures  for  actually  giving  the 
tests.  They  also  attended  faculty  meetings  In  which  the 
exact  procedures  were  reviewed  In  detail. 

In  addition  to  all  these  meuiy  teachers  who  gave  the 
tests,  school  principals,  guidance  people,  and  superin¬ 
tendents  of  schools  spent  many  hours  in  helping  to  prepare 
the  teachers  to  give  the  tests. 

The  responsibility  for  deciding  to  give  the  tests  was 
that  of  the  superintendents  and  principals.  Occasionally, 
Board  of  Education  members  were  brought  In  to  consider  the 
problem.  The  decision  to  participate  was  made  after  these 
people  gave  careful  consideration  of  the  relative  merits 
to  be  gained  from  giving  these  tests,  versus  the  know¬ 
ledge  that  might  be  gained  by  two  regular  days  of  instruc¬ 
tion  In  class  rooms. 

The  superintendents.  Board  Members,  principals,  teachers, 
and  guidance  people  gave  time  and  effort  without  any  addi¬ 
tional  salary,  or  with  little  special  zecognltlcm. 

Almost  a  year  before  the  testing  tocdc  place,  the  first 
steps  were  taken  idilch  would  eventually  get  the  tests  on  the 
desks  of  the  stiidents. 
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]  The  BeglorULl  Coordinators 

The  Story  of  Project  Tttlent  vas  taken  directly  to  the  • 

school  people  and  to  the  students.  Only  throu^  their  com- 
plete  understanding  and  cooperation  could  the  Project  goals  ^ 

he  realized.  This  Joh  vas  done  hy  90  Beglonal  Coordinators.  , 

In  the  summer  of  1959>  the  Project  Staff  began  assem¬ 
bling  a  list  of  outstanding  educators  and  psychologists  vho 
could  be  expected  to  be  able  and  willing  to  work  with  the 
schools  In  administering  the  tests .  late  fall^  the 
Regional  Coordinators  had  been  selected. 

These  men  and  women  were  outstanding  not  only  In  their 
professions >  but  had  long  records  of  success  In  dealing  with 
other  people.  Many  of  the  Regional  Coordinators  accepted  the 

s 

Job,  knowing  that  It  would  have  to  be  done  on  time  outside  of 
their  regularly  held  positions.  Here  eu^e  some  of  the  posi¬ 
tions  they  held: 

Heeul  of  a  Department  (Education,  Psychology, 
or  Guidance)  Of  a  University 

Professor  of  Education,  Psychology  or  Guidance 

Dean  of  a  Graduate  School 

Director  of  Research  of  a  Public  School  System 

State  Guidance  Supervisor 

Director  of  a  High  School 

Director  of  a  Student  Counseling  Bureau 

Dean  of  a  University  School  of  Education 

%  Director  of  a  Guidance  or  Counseling  Center 

Assistant  Superintendent  of  Schools 

! 

!  Director  of  Ku«au  of  Special  Services 

for  Pupils 

Director  of  Testing  and  Evaluation  Services 
!  for  Board  of  Education 


Director,  Bureau  of  Educational  Reaearch 
and  Service 

State  Director  of  Testing,  Guidance  and 
Counseling 

Coordinator  of  Secondary  School  of 
Education 

University  Examiner 

Director  of  Student  Personnel  (University) 
and  many  others. 

Sane  of  the  Regional  Coordinators  vere  in  private 
practice;  others  had  retired,  but  vanted  to  help  in  the 
project. 

One  link  among  the  Regional  Coordinators  vas  their 
common  interest  in  the  young  people  of  our  country,  in 
their  education,  guidance,  and  vocational  success.  They 
have  devoted  their  professional  lives  persistently  toward 
understanding^  guiding,  counseling  and  educating  students,  and 
toward  improving  education  in  the  United  States. 

♦  As  it  turned  out,  they  were  called  upon  to  demonstrate 
some  personal  qualities  which*  vere  not  expected  of  them. 
Regional  Coordinators  Visit  the  Schools 

The  Regional  Coordinators  made  trips  to  each  of  the 
schools  to  tell  the  story  of  the  Project  to  school  people 
and  to  stvidents,  and  to  help  in  preparing  the  teachers  to 
give  the  tests. 

Getting  an  appointment  was  scnetimes  challenging.  One 
coordinator  reported: 

"One  school  didn't  have  a  phone.  In 

fact,  the  principal  didn't  have  a  phone 

in  his  house,  eitherr" 
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Then,  getting  to  a  school,  ¥ae  of^n  acre  chaUenging.  One 

•  ^  ’'  J  ”  '  . .  ’  .  ‘  ^ 

coordinator  reported: 

"Some  of  njr  travel  vas  done  at  the  very 

time  vben  heavy  winter  snows  made  some  * 

of  the  mountain  passes  lapassahle.  1 
had  to  huy  chains  to  resich  one  city." 

From  another: 

"For  three  successive  weeks  1  had  to 
cancel  a  trip  to  the  hulk  of  my  schools 
because  of  snowstorms  that  made  it 
questionable  whether  I  would  have  gotten 
throuid^.  As  it  developed,  one  or  more 
of  the  scboole  had  dismissed  classes  on 
each  of  those  three  weeks,  so  the  trip 
would  have  been  fruitless  in  any  event." 

And  from  another: 

"I  located  the  town  on  the  map,  ai:d  found 
a  road  that  cut  out  quite  a  bit  of  the 

distance.  Hy  car  got  mired  down  in  the  * 

road*  .  .tow  truck*  .  *I  ended  up  driving  ^ 

200  miles  arovind  to  get  to  a  place  that 
was  only  25  miles  away." 

Some  of  the  reports  from  the  Begloral  Coordinators  de¬ 
scribe  best  the  general  reception  they  received  at  the 
schools: 

"****..  *the  eagerness  of  many  school 
people  to  participate  In  a  project  of 
natlonsd.  scope  and  significance* .  Sone 
principals  and  superintendents  hardly  let 
me  finish  my  spiel  before  they  volunteered 
the  help  of  their  schools .  Although  I 
always  represented  the  school  selection  as 
a  random  one,  there  vas  a  strong  tendency 
on  the  part  of  school  people  to  give  parti¬ 
cipation  in  the  project  some  honorific  value.  *  ." 

"*  .  *lt  was  most  gratifying  to  receive  the 
full  and  unselfish,  cooparatlon  of  the  schools 

*  •  *  .Hot  once  did  I  encounter  any  outward 
animosity,  distrust,  or  an  indifferent  atti¬ 
tude  toward  this  project.  Ivexy  school,  Isurge 
or  small,  gaye  the  l^pressloa  that  th^r  Mre 

sincerely  intereated  In  doing  all  that  they  * 

possibly  can  for  the  students. in.  their  schools,  ' 

and  were  dellcdtted  at  the  opportunity  to  parti¬ 
cipate  in  such  a  project  even  thoucd^  it  demanded 
they  interrupt  their  regular  school  schedvae  for 


tvo  full  days*  .  .The  people  lit  these 
schools  are  deeply  concerned  vlth  the 
edue&tlTe  process  and  are  Interested  in 
doing  vhat  is  best  within  the  llJiita>- 
tlons  Tuader  which  they  operate  for  their 
students.” 

”.  .  .  .  .probably  my  nost  ylyld  Isgpres- 
slon  would  be  the  excellent  cooperation 
of  the  secondary  school  personnel  In** 
volred.  .  .  . 

”...  .princlpeOs  at  at  least  two  schools 
were  saisplelous  of  me*«*»thlBkiBg  that  their 
schools  had  been  selected  because  of  their 
ponrtyWboth  Instructionally  and  econonl^ 
cally.  .  .Interestingly  eneug^j  thou£^^  I 
encountered  no  real  hostility  anywhere.” 

These  arsj  of  course,  subjective  and  Isq^sslonlstle 
accoimts.  They  could  be  affected  by  the  time  of  day  or  the 
day  of  the  week  on  which  the  school  was  visited.  They  do, 
however,  saiggest  that  school  people  generally  were  eager  to 
help  In  a  project  which  would  benefit  sttidents  now  and  in  the 
future. 

Preparing  the  Teachers  to  Do  the  Testing 

Oivlng  a  Standardised  Test.  What  is  so  different  about 
a  teacher  giving  a  test  on  the  subject  he  is  teaching,  and 
giving  standardised  tests  such  as  the  Project  Talent  tests? 

Teachers  give  tests  regularly  as  a  part  of  course  work 
so  that  they  can  cheek  on  how  well  the  instruction  is  going 
over,  if  the  students  are  progressing  at  the  pace  they  should, 
if  they  are  studying  and  for  a  variety  of  other  reasons. 

Very  often  the  content  of  these  tests  reviews  the  material, 
idxich  has  been  taught  in  a  previous  ve^  or  month.  The 
teacher  can  check  on  how  well  the  students  are  studying 
the^  asslgaments  and,  in  addition,  have  some  basis  for 
assigning  grades  In  courses.  Generally,  each  teacher  spends 
considerable  time  outside  of  class  making  up  these  tests,  and 
then  grading  them.  A  test  may  take  a  class  period,  or  it 


aay  be  a  qvU.z  'which  -bakea  oxily  5  mlnu-bea.  The  length 
and  content  depend  lar^^ly  upon  the  Individual  teacher. 

A  etandardlzed  teat,  howymr,  la  eonatracted  ao  that 
the  queetlona  'will  aeaaure  aoane  apeelfle  kind  of  knov'^ 
ledge,  trait,  Intereat  or  other  faeet  ef  an  Individual. 
Tor  ucaaqple.  In  the  aubjeet  natter  area  of  nechanlca, 
-there  are  oertaln  baale  Ideaa  or  prlnclplea  'Which  are 
laqportant  for  everything  In  the  field,  such  aa  geara, 
puU^B,  levera,  i^ela,  and  othera.  A  teat  of  neehanl-* 
cal  aptitude,  -then,  veuld  Include  queetlona  on  theae 
prlnclplea.  The  'total  aeore  on  -the  -teat,  thua,  Indl- 
catea  how  -well  the  atudent  tmderatands  -the  prlnclplea 
vhlch  are  Invol-ved  In' nechanlca.  If  a  teat  la  -well 
conetructed,  a  atudent  nlg^t  take  It  again  and  atlU 
get  practically-  the  aaae  ecore. 

Proceeding  further,  a  etandardlzed  -teat  la  alwaya 
admlnlatered  -the  aaoe  -way  to  all  atudenta  -who  take 
It.  The  direction  for  the  teat  are  -written  down  In 
a  manual,  and  are  read  -to  the  atudenta.  Qenerally, 
there  la  a  time  limit  for  a  atandardlzed  teat,  -which  muat 
be  carefully  kept,  alnce  If  one  atudent  -were  allowed  a 
few  more  aeconda  than  the  standard  or  ea-tabllahed  time, 
he  -would  ha-ve  an  ddvanteige  o-ver  other  atudenta. 

In  aoorlng  -the  teat,  there  la  no  gueaawoxk  about 
idiether  an  anawer  la  ri^t  or  wrong.  The  rulea  and 
standeucda  for  correct  anawera  are  aet  up  befcnrehand. 

Vhan  a  test  le  developed,  given  and  aeored  eere«^ 
fully,  and  Impartially,  It  la  posalble  to  aay  with 
aoiK'  cmfldence  that  -we  ha-ve  meaaured  accurately,  acme 
part  of  the  person. 


Furthermore,  if  someone  else  eidulniatered  the  same 
test  to  another  group  of  students  at  a  later  time  and 
If  the  directions  were  followed  precisely,  any  student 
could  be  compared  with  the  scores  of  the  group  which  was 
first  tested,  and  his  score  evaluated.  Therefore,  to  make 
a  ncore  on  a  standardized  test  meaningful,  a  lot  of  care 
must  be  used  by  teachers  In  giving  the  test. 

Problem;  Training  18,000  Teachers 

The  problem  In  Project  Talent  was  to  train  over 
18,000  teachers  to  give  30  standardized  tests  In  the 
same  way. 

In  some  of  the  schools  there  were  counselors  with 
considerable  training  emd  experience  In  giving  standard¬ 
ized  tests.  In  these  schools,  the  counselors  could  help 
the  teachers  give  the  tests.  In  other  schools  there  were 
limited  or  no  cotmsellng  facilities,  and  teachers  had 
never  given  standardized  tests  before. 

i 

Thus,  the  amoxmt  of  training  necessary  varied  from 
school  to  school,  depending  on  the  e;qperlence  of  the 
stGiff  and  the  facilities  available.  In  some  cases,  the 
BegLonal  Coordinators  briefed  the  counselors,  who  then 
went  over  the  details  of  testing  with  the  teaching  staff. 

In  other  cases.  Regional  Coordinators  personally  went  over 
every  detail  of  the  two -day  program  to  be  sure  that  the 
procedures  were  ccm^letely  understood. 

!a>e  Thats  Arrive 

When  test  materials  arrived  at  the  school,  they  were 
essentially  the  responsibility  of  one  person— generally 
the  school  principal  or  hecui  counselor.  It  was  his  Job 
to  receive  the  materleLls  and  distribute  them  on  the  test¬ 
ing  days;  gather  the  materials  up  at  the  end  of  each  half-day; 
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and  orgBuolSe  the  aziaver  sheets  for  shlpstent  to  the  Mea- 

sureoent  Besearch  Center,  and  of  course,  ami  tor  the  i 

testing. 

In  all,  17  different  Instrunents  were  developed  for 
the  schools'  use  In  conducting  the  tests.  ISiese  Included 
not  only  the  test  hooklets,  egid  answer  sheets,  but  teacher's 
guides,  appendices  to  teacher's  guides,  aids  to  students  In 
filling  out  the  special  answer  sheets,  student  Identifica¬ 
tion  cards,  special  header  sheets  which  were  to  be  used 
for  the  return  of  answer  sheets,  s^iool  questionnaires, 
mailing  labels,  etc. 

In  addition,  there  was  a  manual  specifically  for  the 
Individual  at  the  school  who  was  responsible  for  the  testing. 

When  the  materials  arrived  at  the  school -  -and  this  was 
a  truck  load  of  boxes  for  the  larger  schools— they  had  to 
be  sorted  and  counted  for  each  homeroom.  School  people 
worked  many  extra  hours  Just  to  make  sure  that  the  materi¬ 
als  that  were  needed  got  to  the  right  rooms  and  that  every 
student  got  the  same  treatment  as  every  other  student  In 
taking  the  tests. 

All  the  effort  of  training  the  teasers,  distributing 
and  collecting  the  materials  was  for  one  purpose—  to  Insure 
that  every  student  had  the  same  opportunity  to  do  well  on 
the  tests. 

Ihe  Tests  Are  Qlven 

All  the  above  preparations  for  giving  the  tests  tocdi 
place  between  l}seeiter  19$9  and  Jiarcii  196Q,  lAisn  the  testing 
actually  began. 

Two  methods  of  giving  the  tests  were  used.  The  most 
common  method,  of  course,  was  for  each  homerooai  teacher  to 
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give  the  tests  to  his  students.  However,  in  quite  a 
number  of  schools,  the  directions  were  read  slmul- 
tanhously  to  all  students  by  one  person  through  the 
public  address  system.  In  such  cases,  sln(%  there  was 
only  one  timekeeper  Involved,  there  was  no  variation  In 
timing  within  the  school.  Teachers,  then,  anted  as 
proctors  In  each  room.  ALthou^  rare  failures  in 
the  public  address  system  did  cause  some  difficulty, 
this  method  appeared  to  be  very  efficient. 

The  tests  were  given  on  either  two  full  school 
days  or  on  fo\ir  half -days  .  Mhea.  they  were  conqpleted, 
the  answer  sheets  were  sorted,  arranged,  and  shipped 
by  the  school.  The  next  step--scorlng  and  processing. 
Giving  and  Takling  the  Tests — A  Summing  Up 

Some  Reasons  for  Fartlclpatlng.  There  Is  a  feeling 
in  many  schools  In  this  country  that  there  Is  "too  mucdi 
testing".  It  Is  not  uncozmnon,  for  example,  for  a  half- 
dozen  standardized  tests  to  be  scheduled  for  the  school 
year.  Teachers  and  administrators  get  the  feeling  that 
they  are  doing  more  testing  than  teaching. 

In  spite  of  this,  when  the  Project  was  explained, 
these  same  people  cooperated— almost  \inanlmoiisly.  There 
are  several  reasons  reported  for  this: 

1.  The  potential  values  of  the  project  were 
grasped  readily  by  the  school  people. 
Counselors,  especletLly,  seemed  to  be 
sensitive  to  the  total  project,  and 
realized  its  worth.  They  were  very 
concerned  that  It  should  be  done 
rigdit,  and  were  able  to  communicate 
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their  concern  to  teachers  and  students. 

This  vas  because  many  of  the  purposes  of 
Project  Talent  cure  In  support  of  guidance 
programs  and  problems.  The  values 
the  test  results  vlU  provide,  In  the  form 
of  guide  posts  for  coimsellng  to  futiire 
generations  of  students  and  parents,  are 
Important  to  many  professional  people  in 
the  schools. 

2.  Many  school  people  felt  that  participation 
was  a  patriotic  contribution.  Thus,  many 
school  people  participated  not  so  much  be¬ 
cause  they  felt  they  could  get  something  out 
of  the  study,  but  because  they  felt  they  were 
cooperating  In  an  Important  National  Project. 

3.  Many  schools  have  had.  little  or  no  opportunity 
to  do  any  testing,  although  they  realize  and 
are  somewhat  eidbarrassed  about  their  lack  of 
physical  facilities,  staff  backgrovmds,  and 
personal  experiences  to  do  testing.  These 
schools,  of  course,  are  generally  small,  and 
In  Is^olated  areas.  The  people  In  these  schools 
are  looking  fomard  to  any  eisslstance  that  can 
be  given  to  them  from  the  outside. 

A  nuaiber  of  faculties ;  voiced  the  sentiment  that 
participating  In  the  testing  was  a  wonderful  learning  ex¬ 
perience  for  them.  Tbisy  felt  that  the  training  given  than 
in  conducting  so  vast  a  testing  program  over  such  a  short 
period  of  time  was  Invaluable. 
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The  Values  for  8t\«ients 

El£^  School  students  seem  to  have  been  enriched  by 
this  experience.  H(mdred8  of  students  have  written  that 
they  are  looking  forward  with  Interestr  amounting  to 
eagerness, for  the  test  results.  Parents  too,  have  written 
that  they  felt  it  was  a  rich  experience  for  their  children 
and  would  lead  -oo  serious  considerations  for  future  plans 
for  their  lives. 

Meat  students  are  vitally  interested  in  themselves, 
and  were  able  to  grasp  the  potential  values  of  the  Project. 
The  experience  of  taking  the  tests  widened  their  breadth  of 
view,  and,  in  many  cases,  made  them  aware  of  the  need  for 
planning  for  the  present  and  futvire,  and  for  attaining  a 
more  intelligent  self -directive  attitude. 

Taking  tests  may  help  to  medee  students  more  aware  of 
one  of  the  most  important  parts  of  \mders tending  our  fellow 
men— that  people  are  different  in  many  ways. 

One  guidance  director  reported  that  she  firmly  believed 
that  the  two  days  of  testing  in  her  school  gave  'the  students 
their  best  two  educational  days  that  they  had  had  during  the 
entire  year.  This  comment  was  made  despite  the  fact  that 
it  was  not  easy  to  arreuige  for  the  testing  of  2000  students 
in  two  days;  to  be  closely  supervised  in  the  process;  and  to 
have  all  this  occiu:  in  an  old  building,  outmoded  by  time. 

The  giving  and  taking  of  the  tests  required  a  tremendous 
amount  of  non-relal)ursed  labor  on  the  faith  that  the  Project 
will  advance  education,  guidance,  and  human  well^ure  in  the 
United  States.  This  would  seem  to  be  em  Innense  vote  of 
confidence  in  the  future  of  our  countiy,  and  in  the  men  and 
women — our  humsui  resources --of  the  future. 
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Chapter  VI 

Processing  and  Analyzing  the  Data 

Since  this  is  the  age  of  autO!natlon--a  Tiajor  factor 
in  making  this  study  possible — the  natsrials  were  planned 
to  facilitate  automatic  data  processing  throughout.  Answer 
sheets  for  tests  and  student  questionnaires  were  set  up  in 
such  a  way  that  they  covild  be  scored,  or  otherwise  pro¬ 
cessed,  on  the  Iowa  Electronic  Test  Scoring  Machine  or  the 
Iowa  Document  Reader — two  machines  discussed  later  in  this 
chapter  which  represent  large-scale  and  completely  up-to- 
date  applicatiors  of  modem  technology  to  data  processing. 

After  the  basic  data  have  been  trensferred  in  appro¬ 
priate  forn  to  punch  cards,  priiiiarily  by  these  two  machines 
the  data  will  be  put  on  electromagnetic  tape  to  permit 
subsequent  processing  on  modem  digital  electronic  com¬ 
puters. 

Use  of  all  these  large  scale  technological  :iarvels  of 
machinery  to  process  the  test  resvilts  and  analyse  the 
data  mi£^t  make  it  appear  to  the  casual  reader  that  there 
is  danger  of  the  individual  getting  lost  in  the  huge  mass 
of  data— (almost  a  half-million  students,  two-and-a-half 
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million  answer  sheets,  and  five  million  IBM  cards).  But 
this  will  not  happen.  The  reader  may  rest  assured  that 
modem  data  processing  methodology  makes  it  relatively 
easy  to  extract  the  data  for  specific  students  or  small 
groups  of  students  with  specified  characteristics  from  the 
mass  of  data,  and  to  study  these  small  groups  of  individu¬ 
als.  For  instance  if  there  txim  out  to  be  any  Nobel  Prize 
winners  in  the  group  twenty  years  from  now,  and  surely  there 
will  not  be  many,  it  will  be  possible  to  locate  their 
records  and  find  out  what  they  were  like  when  they  were  in 
high  school.  Furthermore  the  use  of  high-speed  computers 
makes  it  possible  to  incorporate  into  the  data  analysis  a 
very  large  number  of  items  of  information  about  each  indiv¬ 
idual-far  more  than  one  could  even  begin  to  consider  if  ' 
this  kind  of  equipment  were  not  available.  The  results 
therefore  can  provide  a  view  in  depth,  not  Just  a  flat  two- 
dimensional  picture  lacking  in  perspective. 

Thus  if  astonishing  progress  had  not  been  made  in  the 
past  few  years  in  the  technology  of  processing  and  scoring 
the  answer  sheets  by  machine.  Project  Talent  would  have 
been  impossible.  Imagine  obtaining  about  100  scores  per 
student  for  about  400,000  students  by  handJ  Only  slightly 
less  fantastic.  Imagine  obtaining  that  many  scores  on  any 
scoring  machine  available  before  about  1950- 

Automatic  scoring  of  tests  has  come  a  long  way  since 
1933,  the  year  that  IBl  came  out  with  the  first  electrical 
acorlng  machine.  The  operation  of  that  machine  relied  on 
the  fact  that  carbon  conducts  electricity.  Since  pencil 
"lead"  is  made  of  graphite,  a  form  of  carbon,  it  is  possible 
to  conduct  electricity  through  a  pencil  mark  on  a. test _ 
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answer  sheet,  thus  closing  an  electrical  circuit  and  caus¬ 
ing  a  point  to  be  added  to  the  test  score.  The  ISM 
machine  based  on  this  principle  took  the  scoring  of 
objective  tests  out  of  the  horse-and- buggy  age.  But  the 
Jet  age  of  scoring  did  not  arrive  until  about  l^^d,  when 
the  Iowa  Electronic  Test  Scoring  Machine  went  into  opera¬ 
tion.  This  machine  uses  photoelectric  cells  (the  basic 
components  that  cause  a  door  with  an  "electric  eye"  to 
open  automatically  when  someone  approaches).  In  the  case 
of  the  Iowa  scoring  machine,  the  answer  sheet  is  scanned 
by  an  infra-red  beam,  and  the  photoelectric  cell  senses 
which  of  the  several  options  for  an  item  is  the  one  which 
has  been  marked.  The  machine  counts  the  nmber  of  "right" 
responses.  Even  if  the  student  has  ignored  the  instruc- ' 
tions  to  mark  only  one  answer  per  item,  or  has  failed  to 
erase  an  answer  thoroxighly  when  he  changes  his  mind  about 
the  answer,  the  machine  can  cope  with  the  situation.  It 
does  this  by  determining  which  one  of  the  several  responses 
that  may  be  marked  for  an  item  is  the  darkest  one;  this  is ' 
assumed  to  be  the  student's  answer,  the  lighter  marks 
-presumably  being  incomplete  erasures.  If  the  two  (or  more) 
responses  are  equally  dark,  the  machine  treats  the  item 
as  if  It  had  been  omitted.  The  machine  scores  at  the  rate 
of  6000  answer  sheets  an  hour  and  can  get  13  independent 
scores  at  a  time,  plus  several  composites,  on  each  of  these 
answer  sheets.  This  means  that  78,000  scores  can  conceiv¬ 
ably  be  obtained  in  an  hour  not  including  composites;  with 
the  addition  of  whatever  composite  scores  may  be  desirable 
the  rate  could  conceivably  go  up  to  well  over  100,000  scores 
per  hour.  Compare  this  with  the  800  scores  per  hour. that 
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would  probably  have  been  a  top  rate  for  machine  scoring  on 
any  earlier  machine.  Then  bear  In  mind  that  this  amount  of 
time  would  have  had  to  be  doubled  since  all  the  answer 
sheets  would  have  had  to  be  scored  twice,  to  Insure  satis¬ 
factory  accxiracy.  (The  Iowa  Scoring  Machine  has  Its  own 
bullt-ln  checks  so  that  rescorlng  Is  not  necessary. ) 

Now  let's  talk  about  a  still  newer  development,  the 
Iowa  Document  Header.  This  Is  not  another  scoring  machine;' 
It  has  an  entirely  different  purpose.  Many  of  the  Items  In 
the  test  battery  are  not  combined  Into  "scores".  They  are 
independent  Items  of  information.  Consider  for  example  the 
answers  to  the  questions  In  the  Student  Information  Blank. 
The  indivld'ual  answers  must  be  preserved,  not  lost  by  being 
combined  in  some  kind  of  composite  with  other  items. 
Eventually,  of  course,  selected  sub-sets  of  these  items 
might  be  combined  In  a  designated  way  to  emswer  certain 
very  specific  questions,  but  the  items  would  still  ha've  to 
be  kept  separate  so  that  other  ways  of  combining  them  coiald 
also  be  tried  if  it  should  seem  desirable.  Then,  of  course, 
there  Is  Record  Form  Z,  which  contains  the  student's  name, 
address,  date  of  birth,  grade,  and  other  information. 
Obviously  All  these  separate  items  have  to  be  recorded 
Individually.  The  Iowa  Document  Header  takes  care  of  the 
situation,  by  making  it  possible  to  transfer  each  Individual 
response  from  'the  answer  sheet  or  record  form  directly  to 
punched  cards.  Like  'the  Iowa  Scoring  Machine,  It  uses 
Xdiotoelectrlc  cells  to  "read"  the  responses  (Xi  the  answer 
sheets— in  other  words  to  sense  which  response  position  is 
darkest  for  each  question.  Two  items  can  be  punched  in 
each  card  column.  Therefore, if  ten  of  the  card's  80  columns 


are  used  for  identifying  information  (the  student's  testing 

number,  etc.),  the  student's  responses  to  as  many  as  l40 
separate  .items  can  be  pvinched  simultaneously  (two  in  each 

of  70  columns)  on  a  single  IB4  card.  ! 

The  initial  processing  of  the  Project  Talent  answer 
sheets  took  place  at  the  Measurement  Research  Center,  in 
Iowa  City,  since  that  is  where  the  Iowa  Scoring  Machine 
and  the  Iowa  Document  Reader  are  located.  The  schools  sent 
the  marked  answer  sheets  directly  to  Iowa  City.  Prelimin¬ 
ary  processing  of  the  answer  sheets,  before  they  were  fed 
into  the  machine,  included  checking  whether  they  were  fully 
identified  as  to  grade,  school,  student  number,  and  other 
necessary  data,  reconstructing  euiswer  sheets  that  had  been, 
badly  damaged  in  transit  (including  one  set  that  had 
apparently  fallen  into  a  bucket  of  apple  green  paint.' ^  and 
other  operations.  Because  these  operations  were  all  of  a 
"clean-up"  type,  and  also  because  this  entire  preliminary 
processing  operation  was  being  carried  out  in  a  building 
that  not  too  long  before  had  been  a  commercieG.  laundry,  the 
operation  soon  became  known  Informally  as  the  "Project  Tal¬ 
ent  Laundry";  or  in  the  interests  of  greater  brevity,  as 
"Operation  UUNDRY". 

In  addition  to  the  activities  mentioned  above,  "Opera¬ 
tion  LAUNDRY"  had  one  other  major  function— namely  the 
extraction  of  a  four  percent  sample  of  all  answer  sheets 
except  those  returned  too  late  for  inclusion*.  This  four 
percent  sample  was  to  constitute  a  subsaiqple  on  which 

tentative  norms  and  other  preliminary  data  analysis  could  be 

based.  Student  Identification  cards,  numbered  serially 

'*  Answer  sheets  received  at  Measurement  Research  Center 
after  7  May  I96O  were  excluded. 
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from  100,001  to  670,000  had  been  printed,.  A  block  of 
these  cards  was  sent  to  each  school,  for  distribution  (one 
card  to  each  student).  The  six-digit  number  was  the  stud¬ 
ent's  testing  number,  which  he  was  to  put  on  all  his  answer 
sheets.  These  testing  numbers  made  it  easy  to  get  a  repre¬ 
sentative  four  percent  sample  (or  to  be  more  precise,  a 
sample  that  would  be  representative  of  those  students  whose 
answer  sheets  had  been  returned  in  time  for  inclusion). 

This  was  accon^lished  by  selecting  all  answer  sheets  that 
had  a  testing  number  with  00,  50,  or  75  as  the  last  two 

digits . 

The  two  answer  sheets  that  were  put  through  the  scoring 
machine  yielded  26  scores  apiece,  or  a  total  of  52  scores, 
plus  8  composites.  Of  these,  37  scores  for  each  student 
were  included  in  the  reports  to  the  schools.  It  was  not 
considered  appropriate  to  report  the  remaining  scores,  since 
all  of  them  were  either  for  tests  of  a  highly  esgperlmental 
character  or  else  they  were  of  such  a  nature  that  they 
would  have  little  utility  for  the  schools.  The  60  scores 
which  were  obtained  on  the  scoring  machine  are  listed  in 


Appendix  VI -A.  The  following  scores  are  the  37  that  were' 
included  in  the  reports  to  the  schools. 


1. 

Information  -  Vocabulary 

2. 

Literature 

3. 

Music 

4. 

Soclsd  Studies 

5. 

Mathematics 

6. 

Hiysical  Science 

7. 

Biological  Science 

8. 

Aeronautics  and  Space 

1  5. 

Electricity  and  Electronics 

10. 

Mechanics 

!  11. 

Home  Economics 

12. 

Information  -  Total 

1  ^3. 

Memory  For  Sentences 

14. 

Memory  For  Words 

I  15. 

1 

I 

Disguised  Words 

.■  - - ...-I-.^-  ...  ...,  .  ...  ..,  ...  ,  .  .  . . . 
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l6.  Eoglish-Spelllng 
17 •  Capitalization 

18.  Punctuation 

19*  English  Usage 

20.  '  Effective  E:q>re8slon 

21.  English  -  Total 

22.  Word  Functions  In  Sentences 
23 •  Beading  Comprehension 

2^ .  Creativity 

23*  Mechanical  Reasoning 

26.  Visxiallzatlon  In  Two  Dimensions 

27.  Visualization  In  Three  Dimensions 

28.  Abstract  Reasoning 

29*  Mathematics  I-Arithmetic  Reasoning 

30.  Mathematics  II- Introductory 

31.  Mathematics  I  +  II 

32.  Mathematics  III -Advanced 
33-  Mathematics  I  +  II  +  III 
34.  Arithmetic  Computation 
35 •  Table  Reading 

36.  Clerical  Checking 
37*  Object  Inspection 

For  most  of  the  tests  the  "raw  score"  obtained  was  a 
"rights  score"—  i.e.,  the  number  of  items  answered  correct¬ 
ly.  For  four  of  .the  tests,  however,  the  "raw  score"  was 
obtained  by  a  formula,  in  which  the  number  of  items  attempt¬ 
ed,  as  well  as  the  number  right,  was  involved.  These  four 
tests,  and  their  formulas,  are  shown  below. 

Arithmetic  Computation:  Score  =  R-3W  =  4r  -  3A 

Table  Beading;  Score  =  R-W  =  2R  -  A 

Clerical  Checking;  Score  =  R-3W  =  4r  -  3A 

Object  Inspection:  Score  =  R-W  =  2R  -  A 

In  the  above  formulas  R  represents  number  of  items. 
right,  W  represents  nxunber  of  items  wrong,  and  A  represents 
number  of  items  attempted.  (Thus  A  =  R  +  W).  The  two  forms 
in  which  each  equation  is  presented  (e.g.,  for  Arithmetic 
Cosiputatlon,  "Score  =  R  -  3\7"  and  "Score  *  4r  -  3A")  are 
mathematically  equivalent.  The  explanation  of  these 
formulas  will  be  discussed  later. 

The  reports  to  the  schools  Included  not  only  the 
"raw  scores"  on  the  37  tests  but  also  the  corresponding 
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"percentile"*.  These  were  the  preliminary  norms  that  had 

been . obtained  on  the  basis  of  the  four  percent  sanqple.  For 

33  of  the  37  scores,  percentiles  had  been  obtained  for  each 

grade  separately;  In  the  case  of  the  other  four  scores, 

which  were  In  areas  In  which  boys  and  girls  customarily 

receive  very  different  training,  separate  percentiles  were 

obtained  for  each  grade-and-sex  combination.  The  four 

scores  given  this  special  treatment  were: 

Information  Test:  Aeronautics  and  Space 
Information  Test:  Electricity  and  Electronics 
Information  Test:  Mechanics 
Information  Test:  Home  Economics 

Tables  showing  the  percentiles  corresponding  to  raw 
37 

scores  on  each  of  the/measrires  appear  In  Appendix  VI-B. 

Additional  preliminary  analysis  of  the  four  percent 
sample  Included  the  detennlnatlon  of  the  Intercorrelatlons 
among  36  variables  for  boys  and  girls  separately,  and 
separately  by  grade .  This  meant  a  total  of  8  tables  of 
Intercorrelatlons.  These  tables  are  presented  In  Appendix 
C. 

In  addition  to  the  60  scores  that  were  obtained  on  the 
scoring  machine  for  everybody,  k6  additional  scores  were 
obtained  for  the  foxir  percent  saa5)le,  primarily  for  research 
use.  These  additional  46  scores  are  Indicated  In  Appendix 
VI-A. 

Most  of  these  additional  raw  scores,  the  reader  will 
observe,  consist  of  number  of  Items  attempted  on  various 


4  X  percenilie  Is  a  numberlcal  value  which  Indicates  how 
someone  stands  on  a  test  or  other  variable  In  cooparlson 
with  a  specified  group.  The  80th  percentile,  to  take  a 
specific  exanple.  Is  the  raw  score  point  below  which  80^ 
of  the  Individuals  In  the  basic  group  score  and  above  \dilcb 
the  remaining  20^  score.  Thus  a  percentile  can  have  any 
value  between  0  and  100. 
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tests.  The  purpose  of  determining  these  counts  was  to 
see  what  the  effect  would  be  of  using  a  raw  score  which 
had  been  obtained  by  taking  into  account  both  the  number 
of  items  answered  correctly  and  the  number  answered  in¬ 
correctly,  instead  of  Just  using  the  number  answered  cor¬ 
rectly,  without  medcing  any  differentiation  between  omitted 
items  and  items  answered  incorrectly. 

When  raw  scores  obtained  by  formula  from  number  right 
and  number  wrong  are  used,  instead  of  J\ist  the  number  right, 
it  is  usually  for  one  of  two  reasons.  The  more  common  of 
these  reasons  is  that  it  seems  desirable  to  use  raw  scores 
which  have  been  "corrected  for  chance".  Somewhat  less 
frequently,  the  content  or  the  purpose  of  a  test  is  of  such 
a  nature  that  more  \iseful  results  can  be  obtained  by  using 
a  scoring  formula  that  differs  somewhat  from  the  standard 
correction- for-chance  formula. 

The  so-called  "correction  for  chance"  is  a  procedure 
for  taking  into  account  not  only  the  number  of  itepis  a 
student  answers  correctly  but  also  the  number  he  answers 
incorrectly  (as  opposed  to  the  ones  he  omits).  The  basic 
assumption  underlying  the  correction  formula  is  that  if  a 
student  gets  an  answer  wrong  it  is  quite  likely  that  he 
guessed;  and  that  if  he  did  not  engage  in  out-and-out 
guessing,  he  obtained  the  wrong  answer  on  some  other  basis 
which  would  occasionally  net  him  a  ri^t  answer  for' a. wrong 
reason.  For  instance,  in  the  case  of  five -choice  items  it 
is  probably  that  for  every  four  items  that  a  student 
answers  incorrectly  he  answers  one  item  correctly  by  chance 
alone,  or  possibly  not  quite  by  chance  but  nevertheless  for 
a  wrong  reason.  In  other  words  it  is  assumed  that  for  every 
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four  items  a  student  answers  Incorrectly  he  answers  one 
correctly  without  really  knowing  the  answer.  If  this 
assumption  Is  correct,  it  Is  entirely  equitable  to  "correct” 
a  student's  score  on  a  test  with  five-choice  items  by  sub¬ 
tracting  from  the  number  he  answers  coi^rectly  one-fourth  of 
the  number  he  answers  incorrectly,  since  this  presumably 
deducts  the  number  of  Items  he  answered  correctly  without 
really  knowing  the  answer.  The  chief  reason  for  scoring 
the  four  percent  saaiple  two  ways  ("corrected"  scores  and 
number  right)  was  to  permit  a  cos^rlson  of  the  resvCLts 
obtained  with  the  two  procedures*. 

As  has  been  Indicated  above,  when  a  scoring  formula 
other  than  "Number  Bight"  Is  used,  It  Is  not  always  the 
correction- for-chance  formula.  For  instance  In  the  case 
of  the  four  tests  on  which  the  scores  are  routinely  being 
obtained  by  formula  for  everyone  (the  Arithmetic  Conrputa- 
tlon.  Table  Beading,  ClerlceO.  Checking,  and  Object  Inspec¬ 
tion  tests),  the  formulas  used  do  not  yield  a  simple 
"correction  for  chance".  If  that  type  of  score  were  to  be 
obtained,  the  formula  would  be 

w 

Score  =  R  -  7]^ 

for  the  tests  with  five-choice  items  (Arithmetic  Confutation, 
Table  Beading,  and  Object  Inspection)  and 

Score  =  R  -  W 

for  the  test  with  two-choice  items  (Clerical  Checking).  In 
the  case  of  these  four  tests,  wrong  answers  are  much  more 

*  At  tke  time  this  book  goes  to  press,  this  comparison  has 
not  yet  been  cosfleted.  The  basic  data  for  this  cooparlson 
will  include  the  correlation  of  the  "Blf^ts  score"  on  each 
test  with  the  corresponding  "corrected  score",  and  also 
tables  of  intercorrelations  among  corrected  scores,  to  be 
compared  with  intercorrelations  among  Rights  scores.  (These 
latter  intercorrelations  appear  in  Appenaix  C.) 
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likely  to  be  due  to  carelessness  than  to  anything  even 
remotely  akin  to  guessing  or  “chance".  Theoretical  con¬ 
siderations  and  past  research  Indicate  that  in  tests  of  this 
■  sort,  where  speed  and  accuracy  in  performing  a  somewhat 
routine  task  (such  as  a  routine  clerical  task)  are  being 
tested,  more  useful  res\ilts  are  usually  obtained  if  a  stiff 
penalty  is  imposed  for  inaccuracy  than  if  the  deduction  for 
errors  is  merely  sufficient  to  counteract  items  answered 
correctly  by  chance.  The  scoring  formulas  that  are  being 
used  for  the  four  tests  concerned  are  ones  that  on  the 
basis  of  past  experience  seem  likely  to  give  good  results. 
However  the  choice  of  these  formulas  involves  no  irre¬ 
versible  commitment.  The  magnetic  tapes  (described  later 
in  this  chapter)  which  will  contain  the  permanent  record  of 
scores  will  preserve  the  "Number  Rights"  score  and  the 
"Number  Attempted"  score  for  each  student,  so  that  if 
future  data  analysis  suggests  that  better  prediction  might 
be  obtained  with  different  scoring  formulas  from  the  ones 
chosen,  the  basic  data  will  be  available  for  applying  the 
preferred  formula.  In  effect  this  amounts  to  treating 
"Number  Right"  and  "Number  Attempted  "  as  if  they  were 
scores  on  two  separate  tests,  and  giving  each  of  them 
whatever  weight  (positive  or  negative)  gives  the  best  pre¬ 
diction  of  whatever  one  happens  to  be  trying  to  predict. 

As  has  been  implied  above,  what  the  best  scoring  for¬ 
mula  is  for  a  test  depends  on  the  purpose  for  which  the 
test  results  are  to  be  used.  A  word  or  two  on  how  this 
works  out  seems  desirable.  A  student's  failure  to  answer 
a  test  item  correctly  is  probably  due  to  one  of  the 
following  reasons: 
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1.  Lack  of  Icnovleclgc  of  the  correct 
ansver.  (This  is  not  a  highly  likely 
reason  in  the  case  of  the  fo;xr  tests 
for  which  a  scoring  formula  other  than 
the  correction- for-chance  formula  is 
being  used. ) 

2.  Carelessness  (This  will  probably  result 
in  wrong  answers,  rather  than  omitted 
items . ) 

3<  Not  having  enough  time  to  reach  the 
items.  (This,  of  course,  results  in 
omitted  items,  not  vrong  ansvisrs . ) 

Since  the  first  of  these  three  reasons  is  not  particu¬ 
larly  applicable  to  the  four  tests  ve  are  concerned  with 
at  the  moment,  the  ones  for  which  a  scoring  formula  other 
than  the  correction-for-chance  formula  is  being  applied 
routinely,  let  us  limit  further  discussion  to  the  second 
and  third  reasons. 

For  prediction  of  success  in  Jobs  calling  for  careful 
performance  of  a  somewhat  routine  task  where  carefulness 
and  accuracy  may  be  considered  more  important  than  speed, 
a  formula  which  has  the  effect  of  penalizing  carelessness 
(as  manifested  by  wrong  answers)  more  severely  than  slowness 
(as  manifested  by  unreached  items)  seems  likely  to  prove 
appropriate.  This  means  a  formula  which  in5>oses  an  extra¬ 
heavy  penalty  for  wrong  answers.  It  is  of  course  conceiv¬ 
able,  however,  that  for  other  types  of  jobs,  in  which 
speed  may  be  far  more  important  than  accuracy,  different 
scoring  formulas  which  imposes  a  heavier  penalty  for  failure 
to  reach  an  item  more  heavily  than  for  a  wrong  answer  would 
give  more  accurate  predictions.  If  such  is  the  case,  we 
shall  find  out  about  it  in  the  follow-up. 

Perhaps  some  of  our  readers  are  becoming  a  little 
concerned  by  now  because  so  much  has  been  said  about  kinds 
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of  scoring  and  data  analysis  and  so  little  about  precau- 

1 

-  tlons  to  make  certain  that  the  data  have  not  been  rendered  ! 

i 

I  meaningless  by  administrative  and  other  errors^  of  one  sort 
:  or  another.  In  a  project  as  huge  as  this  one,  it  is  inevit^ 

I  able  that  not  eveiyone  who  participates  in  the  task  of 

! 

I  administering  the  tests  will  follow  directions  perfectly, 

;  and  that  there  will  be  some  schools  in  which  things  do  not 
go  smoothly.  Fire  alarms  can  occur  at  unexpected  times; 

■  clocks  can  break  down;  so  can  stopwatches;  test  adminis- 
,  trators  can  turn  to  the  wrong  page  in  the  Teachers'  Guide 
for  use  in  administering  the  Project  Talent  Test  Battery 
and  therefore  use  the  wrong  time  limits;  other  things  too 
can  conceivably  go  wrong.  How,  then,  can  one  be  sure  that 
the  data  will  not  be  hopelessly  distorted  by  resultant 
inaccviracies,  and  that  conclusions  consequently  will  not  be 
hopelessly  wrong?  The  answer  is  that  great  pains  have  been 
taken  to  get  as  complete  and  accurate  a  record  as  possible 
of  all  irregularities  that  occurred  in  the  testing,  so  that 
if  these  irregularities,  in  the  considered  Judgment  of  the  • 
Project  staff,  are  sufficient  to  invalidate  the  results  for 
the  students  affected,  the  scores  involved  can  be  labeled 
invalid,  and  eliminated  from  the  data  analysis.  The  Test 
Record  Form,  which  is  shown  in  Figure  1,  is  the  primary 
source  of  the  necessary  infonoation  for  this  pui’pose.  Not 
only  does  it  provide  a  record  of  all  irregularities  that 
occurred  in  the  testing,  but  it  also  indicates  the  testing 
numbers  of  the  students  affected. 

A  supplementary  form,  the  "Local  Coordinator’s  Record 
of  Identification  Numbers",  which  is  shown  in  Appendix  D, 
serves  several  purposes,  one  of  which  is  to  supple-ment  the 
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Test  Record  Form  in  Indicating  which  students  are  in  the 
group  affected  by  a  particular  irregularity. 

However  the  data  processing  procedure  was  such  that 
it  was  not  feasible  to  incorporate  the  Information  from 
the  Test  Record  Forms  as  early  in  the  chain  of  operations 
as  would  be  necessary  if  this  information  were  to  be  used 
in  the  analysis  of  the  four  percent  sanple.  Therefore  In 
that  analysis  other  means  had  to  be  used  for  screening  out 
q\iestlonable  scores.  The  Interim  screening  mechanisms 
\ised  were  documents  called  Group  Identification  Sheets. 

There  were  two  kinds— Type  I,  to  be  used  with  Answer 
Sheets  A  and  C  (the  scoring  machine  answer  sheets),  and 
Type  II,  to  be  used  with  Answer  Sheets  B1  and  B2  and  Record 
Form  Z  (the  document  reader  sheets).  They  are  shown  In 
Figures  VI-2a  and  VI-2b,  respectively. 

The  schools  had  received  instructions  to  separate 
those  answer  sheets  that  contained  tests  administered  under 
irregular  conditions  behind  appropriately  identified  Group 
Identification  Sheets,  one  for  each  grade  group.  The  corre¬ 
sponding  packs  of  enswer  sheets  containing  only  tests  that 
were  free  of  irregularities  in  administration  were  to  be 
put  behind  other  appropriately  labeled  Grovq>  Identification 
Sheets . 

All  emswer  sheets  in  the  four  percent  sample  which 
had  been  identified  as  containing  irregularities  according 
to  the  Group  Identification  Sheets  were  eliminated  before 
the  results  were  analyzed  and  the  preliminary  norms 
obtained.  Thus  the  entire  answer  sheet  was  eliminated  even 
If  only  one  test  on  it  involved  irregularities.  (This  very 
conservative  policy  was  necessitated  by  the  fact  that  the 
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TALENT  Testing  Program 
GROUP  IDENTIFICATION  SHEET  -  Type  I 
For  use  with  Answer  Sheets  A  and  C 

Directions  for  filling  out  this  form  appear  in  the  LocaT  Coordinators'  Manual  in 
Paragraph  IX.  Please  read  these  directions  and  follow  them  carefully. 

Please  prints  School 

1.  Name  of  school  '  Code*  _____ 

City  State  _______________ 

2.  Group  which  this  Sheet  accompanies  (check  one): 


Grade  7 
Grade  8 
Grade  9 
Grade  10 
Grade  11 
Grade  12 
Grade  13 


Special  Sample  (15  year-olds) 
Other  (specify)  ______________ 


3.  Answer  sheet  which  this  sheet 
accompanies  (check  one): 

_ A 

_ C 

4.  The  test  administration  for 
these  cases  was: 

_  Standard  (i.e.  it 

involved  no  irregulari¬ 
ties) 

_  Irregular  (i.e.  it 

involved  irregulari¬ 
ties  reported  on  the 
Test  Record  Form) 

5.  Number  of  answer  sheets  in  this 
pack  ________ 


FT - 

O  ♦ 

•  0) 

iz  < 


U  03  . 

O  0)  U 
>u  — I  0) 

C  .  03 
m  ca  ji  9) 
•rJ  C3.  CO  .33 
43  g 


0 

_  c 

W  E 


O  03  0) 

lu  u  B  n 

M  CO  <  3 


„'®®®©®®©©@© . 

^  @@®©®©©@®© " 
OT®@®©®©®©©©- 


o 

o 

43 

u 

CO 


®@®©®©(S)©®© ' 


©:oio:oi(Kcgo:®:®To. 


o@@©®©©©©@©> 


fC - 

o  • 

.  CO 

o  c 
z  < 


b  m 
O  0)  ^ 
iw  ^  « 
C  •  CO 
03  CO  jB  0) 
•-C  CU  CO  43 

U  03  0) 
cu  W  B  to 
M  CO  3 


!  @@®©®©@©@© « 


KoiGioicToToi©:®:© 


©®@©^xS)©S)@©  < 


o 

o 

oC 

o 

CO 


.©.oio:®:©:©:©:®:®:©. 


0  ©@@©@@@©@0 


apBJO^ 


BQ^QSBSi 


"l-idmes  oadsO 


@0eoeQso9©ego— ogxMWMxwoeei 


*  School  code  is  always  a  letter 
followed  by  three  digits. 

PLEASE  —  Keep  this  form  clean  .and  free 
from  stray  marks.  Do  not  fold 
it  or  bend  the  corners. 


^  ©0®@@3(9©®@0®Q9®©®e@ee@®(9@©®' 
Q0®©@9©@®00®Q(i)@@@@®@e®@®®©® 


b 

©  4.. 

bO^’  Z  ® 

s  s®  ® 

0)  b  H  M  c 

Vi  (y 

C-jC 

b  CO  CO  a  (0  .O 

b  .-c  b]  Q  W  U 

•rf!  CO 

1 

•“<  "I  H  <  CO  CO 

DBD  D3B0D9 


VI«ia  n  yi 

TALEIfT  Testing  Program 
GROUP  IDENTIFICATION  SHEET  -  Type  tl 
For  use  with  Record  Form  Z  and  Answer  Sheets  B1  and  B2 


n  Figure  VI-8b 


Directions  for  filling  out  this  form  appear  In  the  Local  Coordinators' 

Manual  in  Paragraph  X.  Please  read  these  directions  and  follow  them  carefully. 


Please  print: 

1.  Name  of  school 


School 

Code* 


State 


2.  Group  which  this  sheet  accompanies  (check lone): 
Grade  7 


Grade  8 


Grade  9 


Grade  10 


Grade  11 


Grade  12 


_  Grade  13 

Special  Sample  (15  year-olds) 

____  Other  (specify) 

3.  Answer  sheet  which  this  sheet  accompanies  (check  one) 


4.  The  test  aduiinistration  for  these  cases  was: 

Standard  (i.e.  it  involved  no  irregularities) 

Irregular  (i.e.  it  involved  irregularities  repor  1. 1’ U  Oi'i 
Test  Record  Form) 

5.  Number  of  answer  sheets  (or  Record  Forms)  in  this  pack:  ^ _ 

■*  School  Code  is  always  a  letter  fol  lowed  by  three  digits. 
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Group  Ideutlfleatloai  Sheet  does  act  contain  the  details 
about  the  nature  of  the  Irregularities*  After  the  Test 
«  Record  Forms  have  been  fully  proeeesed  and  the  data  they 

X  contain  Incorporated  vlth  test  results^  It  will  be  possible 

'  to  salvage  data  on  "Irregular"  ansVei^  sheeta  by  eliminating 

only  those  scozms  that  cure  affected  by  the  irregularity.) 

After  the  basic  data  liave  been  transferred  In  appro<« 
prlate  foim  to  punch  cards,  primarily  by  the  Scoring 
Machine  and  the  Document  Reader,  the  data  will  be  put  on 
electrcauLgiietic  tape  (often  eeJled  magnetic  tape)  to  store 
it  con^antly  and  to  permit  subsequent  proeessing  on  modem 
^  digital  electronic  computers. 

Most  of  the  data  processing  will  be  done  on  the  giant 
^  computer  at  the  University  of  Pittsburgh.  This  machine  is 

an  "IBM-7OT0”#  and  even  In  comparison  with  most  other 
<  electronic  computers  currently  in  use  It  is  eapable  of 

prodigies,  in  tezms  of  volume  and  speed  of  data  handling 
and  slao  in  terms  of  versatility.  The  'jcr[0  is  still  a  com¬ 
paratively  IMW  machine— conqpeuratively  new  even  in  a  field 
where  technological  progress  is  so  rapid  that  yesterday's 
eighth  wonder  of  the  world  la  today's  eemmonplace  and 
tomorrow's  obsolescent  relic. 

The  7070  a  solid-state  (transistorized)  fully 
"buffered"  hig^^speed  general-purpose  decimal  computer 
that  can  "remember"  as  many  as  99900  digits.  Die  memory  is 
in  the  form  of  "core  storage*'.  The  campateT  uses  high- 
density  tape  and  It  can  run  aa  massy  as  six  reels  at  a  tlzm. 

*  In  addition  to  the  tape  input  and  output  it  also  has  curd  in¬ 

put  (a  high-speed  card  reader),  C6u?d  output,  and  a  printer. 
Those  of  our  readers  ■»dio  happen  to  be  "computer  buffs"  will 


h&ve  no  trou'ble  uadsrstaxuilzig  the  technical  tems  In  the 
precedl33g  sentence.  As  for  the  rest  of  our  readers  ve  apol» 
oglze  for  not  explaining  these  technical  terns  in  detail 
but  limitations  of  space,  and  perhaps  of  reader  patience, 
seems  to  make  tvieh  a  digression  inadvlsalile.  We  viU 
therefore  pause  only  long  enoufpi  to  mention  one  additional 
feature,  idiidh  is  one  of  the  very  newest  vrinkles  in  ccm- 
puter  de8ign*M>so  new,  in  fauzt,  that  the  is  one  of  the 
very  few  eoiq^uters  beyond  the  drawlng*>board  stage  that  haye 
it.  This  is  the  fact  that  the  computer's  "automatic  prioxlty 
processing"  feature  makes  it  capable  of  running  sereral  ccmio 
pletely  independent  programs  at  the  same  time.  This  feat 
would  perhaps  be  somewhat  analogous  to  that  of  a  person 
idio  could  cooqpose  a  sonnet  in  French  and  commit  it  to  paper 
with  hie  rle^t  hand,  idiile  uaing  his  left  hand  to  solve  a 
mathematical  equation,  and  at  the  same  time  cotild  carry  on 
a  sensible  conversation  about  the  latest  beat^aeller. 

13iou£^  this  hypothetical  stimt  is  quite  a  bizarre  one,  and 
not  notably  practical,  the  7070’ »  corresponding  capability 
for  unrelated  slmultaneoua  activities  can  be  put  to  really 
practical  use.  It  was  fortxmate  that  this  machine  became 
available  Just  in  time  for  Project  Talent. 

Nov  let's  get  back  to  the  magnetic  tape  on  -vdiich 
scores,  item  responses,  and  other  data  for  each  of  the 
Project  Talent  students  have  been  recorded.  Soto  of  ovir 
readers  may  be  surprised  to  learn  that  the  record  is  an 
invisible  onel  XMLike  the  information  punched  in  cards, 
which  is  represented  by  very  visible  rectajagular  holes,  the 
information  recorded  on  magnetic  tape  is  represented  by 
invisible  patterns  of  magnetized  spots.  Since  there  is  no 
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need  for  the  record  to  be  visible  to  the  hrunan  eye,  it  can 
be  extremely  con^jact.  Thus  a  2lt00-foot  reel  of  half -inch-:- 
wide  tape  has  a  diameter  of  only  ten  and  one-half  inches 
but  can  contain  about  15  million  individual  characters. 
(Each  character  Is  eillier  a  letter  of  the  alphabet,  one  of 
the  ten  digits,  or  a  special  symbol.)  Now  to  give  the 
reader  some  idea  of  the  speed  with  which  the  JOJO  can 
handle  these  tapes  perhaps  it  will  suffice  to  mention  that 
an  entire  reel,  containing  about  15,000,000  characters, 
can  be  nan  through  the  machine  in  well  imder  ten  minutes. 


Conqpactoess  of  storage  and  speed  of  pi'ocessing  have 
been  mentioned  as  advantages  of  magnetic  tape.  A  third 
major  advantage  is  flexibility.  It  will  be  necessary  to 
bring  the  tape  up  to  date  after  the  one-year,  five-year, 
ten-year,  sind  20-year  follow-ups.  This  can  be  handled 
automatically  if  the  machine  is  "programmed"  appropriately, 
(l.e.,  if  the  machine  is  given  appropriate  instructions 
appropriately  expressed  in  machine  languaige). 

Most  of  the  x«st  of  this  chapter  will  be  devoted  to 
plans  for  data  analysis.  Before  we  concern  ovirselves  with 
methodology  a  brief  discussion  in  broad  genereJ.  terms  of 
the  kinds  of  analysis  contemplated  seems  in  order. 

The  kinds  of  analysis  that  are  possible  are  of  course 
implicit  in  the  instruments  developed  and  the  kinds  of  data 
collected.  It  will  be  possible  to  find  the  answers  to  many 
questions  about  what  the  typical  high  school  student  is  like— 
his  aptitudes,  abilities,  activities,  interests,  background, 
and  plans;  also  what  the  atypical  high  school  student  is 
like.  The  sample  is  sufficiently  large  that  it  will  be 
possible  to  identify  reasonable  numbers  of  students  with 
highly  superior  abilities,  students  with  plans  to  go  into 
occupations  for  which  few  people  can  qualify  (e.g.,  nuclear 
physicist),  students  with  unusual  comb-' nations  of  traits, 
unusvial  interests,  etc.,  find  out  what  they  are  like,  and 
see  what  happens  to  them.  In  other  words  extremes  as  -well 
as  means  can  be  studied. 

But  more  than  that,  the  Project  is  not  limited  to  study¬ 
ing  secondary  school  students.  Because  an  entire  age  group- 
all  15-year-olds  whether  in  secondary  school  or  not — wan 
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sampled,  it  will  be  possible  to  draw  some  inferences  in 
regard  to  this  much  broader  and  more  general  base— which  in 
a  sense  is  a  random  sampling  of  "people-in-general",  since 
evez^ne  who  survives  past  his  fifteenth  birthday  is  a 
fifteen-year-old  at  one  time  or  another,  while  not  every¬ 
one  is  at  some  time  a  secondary  school  student. 

Furthennore,  the  Project  will  not  be  limited  to  study-  . 
ing  people  (either  "people-ln-general  when  they  are  fifteen 
years  old"  or  "people-who-go-to-secondary-school").  In 
addition  special  studies  will  be  done  of  schools .  With 
1357  schools  being  tested  and  with  procedures  for  weighting 
the  schools  so  as  to  reconstruct  the  "popiilation"  of  second¬ 
ary  schools  in  the  United  States  as  a  whole,  it  will  be 
possible  to  find  out  what  typical  schools  are  like,  how 
schools  differ,  and  how  the  characteristics  in  which  they 
differ  axe  related  to  their  success  in  educating  yo\mg 
America.  Perhaps  most  important  of  all,  the  results  may 
even  point  the  way  to  how  some  schools  can  improve  their 
program--what  ways  of  utilizing  available  resources  (mone¬ 
tary  and  other)  will  result  in  the  greatest  increment  in  the 
degree  to  which  they  succeed  in  their  objectives. 

Almost  all  of  the  data  analysis  still  lies  ahead.  Since 
this  is  so,  there  seems  to  be  little  point  in  disc\issing 
methodology  in  great  detail  at  this  stage.  However,  general 
procedures  and  problems  that  are  expected  to  apply  throughout 
may  be  discussed  with  profit. 

One  of  the  general  problems  is  how  the  total  group  of  a 
half-million  cases  shall  be  divided  into  sub-groups  for  anal¬ 
ysis.  Obviously  it  is  undesirable  to  throw  a  half-million 
students  together  in  an  undifferentiated  mass.  Therefore 


It  is  expected  that  In  general  whatever  analyses  are  done 
will  be  done  separately  by  grade,  and  In  most  cases  the 
boys  and  the  girls  within  a  grade  will  also  be  analyzed 
separately.  Where  these  breakdowns  still  give  larger 
groups  than  it  seems  desirable  to  handle  as  a  unit,  the 
group  can  readily  be  broken  down  Into  ten  smaller  groups, 
by  use  of  the  ten-  subsan^les  of  schools  which  the  reader 
will  recall  were  described  in  Chapter  3  (on  page.  ). 

In  addition  to  the  breakdowns  described  above,  the  group 
can  also  be  divided  on  a  geographic  basis,  so  that  regional 
norms  can  be  obtained;  norms  will  be  obtained  for  all  sorts 
of  special  groups  as  well,  to  supplement  the  national  norms. 

In  the  case  of  the  special  study  of  the  15-year-olds, 
the  boys  and  girls  Included  will  come  from  two  sources--: 
students  in  the  regular  sample  who  were  in  grade  10,  11, 
or  12  in  one  of  the  randomly  selected  high  schools  (or  an  ’ 
associated  Junior  high  school),  and  the  special  group  of 
I5-year-olds  who  were  not  in  high  school  at  all.  Appropri¬ 
ate  weights  will  have  to  be  applied  to  the  data  for  students 
from  these  two  sources  before  they  can  be  combined.  This 
is  necessary  to  take  account  of  the  fact  that  the  group  not 
in  high  school  represents  only  one-tenth  as  many  school 
districts  as  the  grovq)  in  high  school. 

Another  problem  which  has  implications  for  many 
aspects  of  the  project  is  that  of  follow-up.  Students  will 
be  followed  up  one,  five,  ten,  and  twenty  years  after 
graduation  from  high  school.  The  authors  feel  quite  opti¬ 
mistic  about  the  prospects  of  getting  excellent  cooperation 
from  the  students.  However  it  must  be  recognized  that  over 

the  course  of  the  years  the  follow-up  will  become 
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proGressively  more  difficult,  as  more  members  of  the  group 
change  their  addresses  and  forget  to  notify  the  Project 
Talent  Central  Office,  or  change  their  names,  or  for  some 
other  reason  become  difficult  to  locate,  or  disinclined  to 
report  their  c\irrent  activities.  One  device  which  the 
authors  have  great  hopes  will  recover  some  of  these  lost 
cases  is  to  reverse  the  follow-up  procedure.  The  reverse 
procedure,  which  is  here  designated  the  "follow-back 
procedure".  Involves  finding  out  the  names  and  approximate 
ages  of  the  members  of  any  specified  group  which  is  of 
particvilar  interest  ten  or  20  years  from  now,  finding  out 
which  members  of  the  group  are  of  the  right  age  to!  have 
been  tested  in  Project  Talent,  and  then  acting  on  the 
ass'umption  that  approximately  5^  of  these  people  were  in 
Project  Talent. (This  is  not  an  unreasonable  assumption, 
since  approximately  5^  of  today’s  high  school  students  are 
included  in  the  Project.)  Let's  see  how  this  follow- back 
procedure  would  work  in  a  specific  instance.  Suppose  that 
about  twenty  years  from  now  there  is  an  interest  in  study¬ 
ing  persons  convicted  of  certain  kinds  of  crimes,  and  find¬ 
ing  out  what  their  characteristics  were  when  they  were  in 
high  school.  Lists  of  persons  convicted  of  the  crimes  cotild 
be  inspected,  and  the  names  of  all  such  persons  who  are  in 
the  right  age  range  could  be  extracted.  IBM  cards  could  be 
pvinched  for  these  persons,  showing  their  name,  date  of 
birth,  sex,  and  other  appropriate  identifying  infornation. 
The  congjuter  would  then  be  set  up  to  "search  the  file"  for 
these  names.  Presumably  about  5^^  of  them  would  be  located. 
The  SAI  scores,  responses  on  the  Student  Information  Blank 
and  Interest  Inventory,  test  scores,  and  other  relevant  data 
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for  these  individuals  could  then  be  studied  intensively, 
and  con^ared  with  the  corresponding  data  for  the  total 
group  in  the  study  or  for  any  segment  of  it.  This  would 
provide  information  on  what  these  people  were  like  when 
they  were  in  high  school,  what  backgrounds  they  had,  and 
in  what  respects,  if  any,  they  differed  from  their  con- 
teniQporaries . 

In  previous  parts  of  this  book  there  have  been 
references  to  the  problem  of  assigning  appropriate  weights: 
to  the  data  to  adjust  for  the  fact  that  different  sangdlng 
ratios  were  en^loyed  in  different  kinds  of  schools  and  also 
to  adjust  for  various  other  circumstances,  such  as  the 
fact  that  a  number  of  schools  that  were  selected  in  the 
sample  declined  to  participate  in  the  project.  To  allow 
for  foreseeable  contingencies,  three  different  sets  of. 
school  weights,  designated  Set  A,  Set  B,  and  Set  C, 
respectively,  have  been  determined,  Eash  is  appropriate 
in  a  different  set  of  circumstances.  Weight  A  is  the 
weight  that  is  applied  to  the  data  when  the  characteristics 
of  students  are  being  studied.  Use  of  these  veldts  makes 
it  possible  to  reconstruct  from  the  sample  an  approximation 
of  the  total  population  of  high  school  students--or  any 
segment  of  this  population  that  is  of  particular  Interest. 
Weight  B,  which  is  exactly  the  same  as  weight  A  for  most 
schools,  is  applied  when  the  characteristics  of  schools 
are  being  studied,  and  it  is  desired  to  infer  something 
about  the  total  group  of  American  high  schools  on  the  basis 
of  the  schools  that  participated  in  the  project.  (Wei|^t 
E  differs  from  weight  A  only  in  the  case  of  those  schools 
where  only  a  fraction  of  the  students  were  to  be  tested.  ' 
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The  only  schools  in  this  category  were  tne  public  schools 
in  New  York  City  and  those  in  Chicago. )  Weight  C,  like 
Weight  B,  is  designed  for  use  where  it  is  desired  to  draw 
inferences  about  the  toted  group  of  Americeui  high  schools. 
However,  xmlike  weight  B,  weight  C  is  used  when  the  data 
being  studied  are  available  for  all  schools  that  were 
selected  in  the  sample,  rather  than  Just  for  those  schools 
which  agreed  to  participate.  It  should  be  pointed  out 
here  that  even  the  schools  that  declined  to  participate 
were  in  most  cases  willing  to  fill  out  the  three  school 
questionnaires.  Therefore,  when  the  data  from  these 
questionnaires  are  being  used  and  test  scores  are  not, 
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CHAPTER  VII 

BACKGROUIO)  AND  DESCRIPTION  OF  THE  TESTS 

In  Section  I  of  this  book,  the  rationale  for  the 
project  as  a  whole>  its  raison  d'etre,  was  discussed. 

Section  II  contains  the  rationale  for  the  procedure  used. 

In  Section  III  the  rationale  for  each  of  the  tests  and 
other  instruments  will  be  presented. 

In  this  ;chapter,  each  test  is  discussed  in  turn,  in 
terms  of  its  purpose,  its  historical  antecedents,  eujd  its 
characteristics.  ISie  section  on  historical  antecedents 
Includes  not  only  a  description  of  earlier  tests  designed 
to  serve  the  same  genez^  purpose  but  also  a  description 
of  ways  in  which  these  tests  have  been  used  successfully 
in  the  past — the  kinds  of  Jobs  for  which  the  abilities 
they  meMure  have  proved  relevant. 

Testing  has  a  long  history— ais  long  as  the  history  of 
schools  and  perhaps  even  longer.  But  to  keep  this  discussion 
of  historical  antecedents  of  the  Talent  tests  within  reason¬ 
able  bounds  we  shall  limit  it  in  general  to  standardl7,ed 
objective  tests. 


Ihe  dlscusBion  of  the  Project  Teilent  version  of  each 
kind  of  test  Includes  a  hrlef  description  of  the  Item  type, 
saaqple  Items, .  emd  a  discussion  of  whether  the  Itmns  used 
are  essentially  parallel  to  those  In  other  tests  having  the 
same  general  purpose,  and  If  not,  to  vbst  extent  they  differ. 
Ihe  reader  may  wish  to  refer  back  to  Table  IV-2  for  a  s\mi- 
mary  of  certain  features  of  the  tests  Including  nvimber  of 
Items  and  number  of  options  for  each.  All  Items  In  all 
tests  are  of  thfe  multiple-choice  type, , and  the  reader  will 
note  from  this  table  that  almost  all  of  them  are  five-choice 
Items . 

A.  Information  Test 
Purpose  of  the  Test 

The  Information  Test  Is  really  several  tests  rolled 
In  one  package  and  printed  In  the  same  booklet.  Devotees 
of  "Alice  In  Wonderland"  and  "Through  the  Looking  Glass" 
will  recall  Humpty  Dunqpty's  use  of  "portmanteau  words"  — 
words  that  have  sevex«l  seemingly  disparate  meanings  at 
the  same  time.  In  much  the  same  way,  the  Information  Test 
has  ^at  mlg^t  be  ceQ.led  a  "portmanteau  purpose".  Ihe  test 
may  be  scored  to  contribute  to  the  meMurement  of  breadth 
of  the  student's  general  Information,  his  vodabulary  level, 
and  the  amount  of  Information  he  has  In  many  specific 
areaa  (including  some  areas  In  which  amount  of  Information 
has  been  found  to  be  an  excellent  Index  of  aptitude,  and 
other  areas,  of  an  academic  nature.  In  which  amount  of  In¬ 
formation  gives  soflw  Indication  of  level  of  scholastic 
achlevesient) ;  the  test  also  helps  Identify  mentally  re<^ 
teutled  students,  cuid  others  who  have  a  serious  reading 
dlsablllty--those  who  reaui  beuUy  enough  to  be  considered 


functionally  Illiterate;  and  students  vhoee  attitude  toward 
the  test-taking  task  is  flippant,  or  apathetic,  or  otherwise 
leaves  much  to  he  desired;  and  students  ^ose  scores  may  be 
pulled  down  by  careless  errors;  and  finally  it  helps  deter¬ 
mine  Trtiether  the  student's  genereil  attitude  In  the  face  of 
une:qplalned  phenomena  leads  him  to  take  a  scientific  view 
in  evaluating  hypotheses,  or  \diether  his  general  attitude 
medtes  him  receptive  to  explanations  which  are  superstitious  . 
or  otherwise  Illogical. 

^is  Is  quite  a  bit  to  fit  Into  a  single  test— even 
If  It  Is  a  long  one,  as  the  Information  Test  certainly  is. 

The  one  thing  that  makes  it  possible  to  achieve  all  these 
ends  Is  the  fact  that  most  of  the  items  contribute  to  more 
them  one  of  the  purposes.  For  Instemce  every  item,  regard¬ 
less  of  what  else  it  measures,  also  contributes  to  the  total 
"general  information"  score.  The  items  that  serve  to  identify 
illiterates  also  help  to  identify  the  inadequately  motivated 
students — provided  that  the  entire  pattern  of  scores  Is 
taken  into  account  emd  that  the  results  are  properly  inter¬ 
preted. 

Historical  Antecedents 

Because  the  purposes  of  the  Information  Test  are  so 
varied,  and  because  the  authors  know  of  no  previous  test 
designed  to  serve  all  these  p\irposes,  the  historical  ante¬ 
cedents  will  be  discussed  for  each  purpose  separately. 

For  purposes  of  this  discussion  we  shedl  define  in¬ 
formation  test  Itons  qviite  broadly,  to  include  Itesu  testing 
eOmost  smy  type  of  information:  information  in  academic 
areas,  information  in  non-academic  areas,  information  about 
hobbles  and  recreational  activities.;  Information  :^acqulred 
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throu£^  formal  Instnustlon,  information  acquired  In  dally 
living,  Information  acquired  throu£^  voluntary  reading; 
information  about  people,  places,,  events,  things,  activities, 
word  meanings.  Items  for  the  last-named  category,  Infoimtlon 
about  word  meanings,  are  usually  called  "vocabuleuy  Items”; 
but  the  distinction  between  Items  specifically  calling  for 
knowledge  of  word  meanings  and  Items  calling  for  other  kinds 
of  Information  is  rather  an  arbitrary  one,  and  we  shall  not 
trouble  otirselves  about  it  at  this  point.  (We  shaill  resume 
the  discussion,  however.  In  a  later  section,  yhsn  we  discuss 
"vocabulary  scores".) 

Our  definition  of  Information  test  Items  Is  sufficiently 
broad  to  Include  not  only  items  which  are  purely  verbal  In 
character  but  also  Items  which  are  largely  pictorial.  In 
the  latter  category  for  Instance,  would  be  an  Item  asking: 

"Which  of  the  following  smlmals  Is  a  jaguar?" 
and  for  options  showing  drawings  of  five  kinds  of  wild 
animals . 

.1.  Measures  of  breadth  of  general  Information.  In¬ 
formation  tests  covering  a  wide  range  of  topics  have  been 
\ised  for  a  long  time  as  conqponents  of  general  intelligence 
measures.  They  were  used  for  this  purpose  as  far  beu:k  as 
World  War  I,  >dien  the  Army  Alpha  Bbcamlnatlon  was  eidmlnls- 
tered  to  eUl  Inductees  Into  the  Army  vixo  could  read  and  write. 
This  was  the  first  mass  program  for  mentsG.  testing  that  ever 
took  place.  The  Army  Alpha  was  a  standardized  objective 
test  designed  for  group  administration.  Qbe  of  Its  el^t 
subtests  was  a  test  of  Information,  which  covered  a  very 
wide  range  of  subject  matter.  To  give  am  Idea  of  Its 
breadth  of  coverage.  It  Included  Items  testing  Information 


on  euilmals  and  birds,  ph^lcal  science,  biological  science, 
fanning,  necheujlcs,  social  stiidles,  electricity,  medicine, 
games,  biunlness,  foods,  airplanes,  sports,  guns,  lay,  liter¬ 
ature,  art,  and  other  topics.  Arthur  S.  Otis,  1dio  played  a 
leading  role  In  the  development  of  the  Army  Aljdia,  later 
used  information  Items  M  one  of  the  chief  con^nents  of 
his  widely  used  Intelligence  tests  (the  Otis  Self -Administer¬ 
ing  Tests  of  Mental  Ability  and  the  Otis  Quick-Scoring  tfental 
Ability  Tests) . 

Use  of  Information  tests  as  an  Indicator  of  general 
Intelligence  level  was  thus  one  of  the  earliest  uses  of 
such  tests  and  It  Is  still  a  very  Important  one.  In  this 
type  of  use  only  the  total  score  Is  of  concern;  subscores 
shoving  amounts  of  Information  In  specific  arr-^e  are  Irrel¬ 
evant  end  are  usually  not  obtained.  A  wealth  of  empirical 
data  has  accumulated  concerning  the  use  of  general  Infor¬ 
mation  as  a  measure  of  Intelligence,  auid  predictor  of  college 
success . 

2.  Measures  of  Interest.  In  the  1930*8  there  waus 
some  experimentation  with  wlde-rauige  Information  euid  vocab¬ 
ulary  tests  as  a  way  of  measuring  relative  Interests.  .For 
Instauice  there  was  the  Michigan  Vocabulary  Profile  Test  (  ), ' 

developed  by  E.  B.  Greene  in  1937*  Ihis  test  consisted  of 
eight  subtests,  measuring  vocabulary  In  the  following  eight 
areaus:  Human  Relations,  Conmierce,  Government,  Riyslca^ 
Science,  Biologies^.  Science,  Mathematics,  Fine  Arts,  amd 
Sports.  The  total  score  on  this  test  clearly  provides  a 
sMSsure  of  general  vocabulary,  but  the  Innovation  which  dis¬ 
tinguished  this  test  from  Its  predecessors  was  the  recommen¬ 
dation  made  in  Its  manual  that  the  profile  of  subtest  scores. 


In  other  words  the  pattern  of  these  el^^t  scores,  be  used 
as  a  clue  to  the  person's  relative  Interests  In  different 
areas  and  as  a  partial  Indication  of  his  relative  aptitude 
for  work  In  these  areas. 

The  use  of  differential  levels  of  Information  In  dif¬ 
ferent  areas  as  a  measure  of  relative  Intereitsi.ls  based  on 
the  premise  that  the  Individual  will  tend  to  know  most  In 
areas  Vhere  his  Interest:  Is  greatest.  Ihus  If  the  profile 
of  his  subscores  shows  peaJts  and  valleys, cthese  extremes 
may  be  taken  to  suggeat  areas  where  his  Interests,  and  thus 
perhaps  his  ability  to  succeed,  are  greatest  and  least, 
(implicit  In  all  this,  of  course.  Is,  the  assumption  that 
the  subtest  scores  have  all  been  converted  to  the  same  scale, 
to  make  them  directly  cosperable,  since  raw  scores  presumably 
would  not  be.) 

The  use  of  information  tests  to  suggest  whether,  an 
Individual  has  sxifficlent  Interest  In  a  field  to  succeed  In 
It  was  greatly  expanded  and  systematized  during  World  War  II 
In  the  Amy  Air  Force  Aviation  Psychology  Program,  \inder  the 
direction  of  John  C.  Flaneigan.  It  proved  very  successful  in 
the  battery  of  Aircrew  Classification  Tests  designed  to  pre¬ 
dict  success  as  an  Air  Force  pilot,  bombardier,  or  navigator. 
Ihls  battery  Initially  Included  a  Technical  Vocabulary  Test, 
which  provided  sepsuate  scores  for  the  three  positions 
named.  The  test  was  later  expanded  to  Inclvide  other  types 
of  general  Information. 

A  battezy  later  developed  by  the  American  Institute 
for  Research  for  use  in  selecting  airline  pilots  and  fll^t 
engineers  made  use  of  many  principles  and  methods  idilch  had 
proved  useful  In  the  Air  Force,  among  them  the  use  of 
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Infomatlon  tests  to  provide  am  ’’operatlosal"  meausure  of  In¬ 
terest  in  flying-*^  meaisxire  based  not  on  laere  verbal,  expres¬ 
sion  of  Interest  but  on  Interest  that  has  been  demons tratedt 
by  the  acquisition  of  Information*  Tbe  extent  to  idilch  Infor¬ 
mation  about  flying  and  other  kinds  of  information  deemed  rele¬ 
vant  Indicate  a  read.  Interest  rather  than  merely  the  acquisition 
of  a  vide  range  of  Information  through  the  operation  of  general. 
Intelligence  can  be  determined  by  cosqparlng  a  score  baaed  only 
on  relevant  Infomatlon  with  a  score  based  on  other  Information, 
or  vlth  the  total  information  score. 

3*  Measures  of  Information  In  specif Ic  areas.  In  addi¬ 
tion  to  their  usefulness  In  Indicating  relative  interest  In 
different  areas,  subscores  on  a  general  Information  test  are 
also  useful  per  se,  as  direct  measures  of  amount  of  Informa¬ 
tion  acquired  In  certain  specialised  areas— for  Instance 
physical  science,  fine  arts,  sports*  She  Michigan  Vocabulary 
Profile  Test,  vhieh  has  already  boon  mentioned  In  connection 
with  the  measurement  of  Interest,  provides  such  scores.  The 
distinction  between  academic  areas  and  non-academic  areas  Is 
a  rather  fruitless  one  In  the  case  of  general  Information 
tests,  since  the  Information  tested  often  Includes  types  of 
facts  that  are  Just  as  likely  to  have  been  learned  out  of 
school  as  from  fozml  Instruction. 

A  second  distinction  that  Is  by  no  means  as  clear  as 
It  Is  sometimes  thou^t  to  be  Is  the  distinction  between 
Information  as  a  measure  of  "aptitude"  and  Information  as 
a  measure  of  "achlevuMnt" .  Many  tests  may  be  regarded  as 
having  elements  of  both.  The  fact  that  a  person  has  ac¬ 
quired  a  lot  of  information  about  a  specialized  area 
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Ixidleates  a  kizxd  of  achievement.  It  also  indicates  that  he 
has  the  aptltide,  and  Insofar  8ls  the  Infonsatlon  vas  acquired 
through  voluntaxy  actlvl'fy;  It  Indicates  Interest  In  the 
area.  In  the  sense  that  past  performance  predicts  future 
perfozmance>  achievement  In  a  field  is  an  index  of  aptitude 
for  It  and  thus  Information  In  an  area  wa^  Indicate  both 
achlevenent  and  aptitude,  nevertheless  there  are  certain 
areas  In  vhlch  these  Joint  achlevement*aptltude  tests  that 
measure  amount  of  Information  have  proved  outatandlngly  use^- 
ful  as  predictors  or  Indicators  of  Job  aptitudes.  Among 
these  areas  are:  (a)  noehanlcal  Information^  (h)  electrical 
and  electronic  Information,  and  (c)  aeronautical  lnfozma> 
tlon.  Each  of  these  vlU  he  discussed  separately  In  a  later 
section  of  this  chapter  since  the  Information  Test  Items  In 
these  three  areas  nay  he  regarded  not  only  as  contrlhutlng 
to  the  total  Information  score  hut  also  as  constituting 
suhtests  In  three  areas  of  specialized  Information  vhlch 
are  embedded  In  the  Information  Test. 

We  have  already  suggested  that  the  distinction 
between  "vocabulary  Items"  (items  testing  knowledge  of  . 
technical  vocabulary)  and  "Information  Items"  (items  test¬ 
ing  possession  of  other  kinds  of  Information,  In  the  same 
field)  as  not  an  Important  one.  Actually  the  two  go  hand- 
in-hand.  Students  who  do  well  on  either  of  the  tvo  types 
of  Items  (technical  vocabulary  Items  and  short  concise  Items 
testing  specialized  Information)  tend  to  do  well  on  -the 
other,  and  students  idio  do  poorly  on  one  tend  to  do  poorly 
on  both. 
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4.  Meaeiirea.  of  vocabulary.  Ihe  reader  should  not  in¬ 
fer  from  the  foregoing  dlsc\isslon  that  the  authors  regard 
scores  of  general  vocabtilary  level  as  unlJi^rtant.  Quite 
the  contrary [  The  size  of  a  person's  general  vocabulary 
has  long  been  recognized  as  one  Of  the  best  indices  of  his 
level  of  general  Intelligence— or  at  least  of  that  very 
logportant  aspect  of  general  intelligence  that  is  called 
"verbal  intelligence".  Vocabulary  tests  of  one  sort  or 
another  have  played  a  prominent  role  in  intelligence  tests 
ever  since  the  first  Intelligence  test,  the  Blnet  scale, 
was  developed  back  in  1905*  Almost . every  intelligence  test 
except  those  specifically  designed  to  be  non-verbal  contains 
either  a  vocabvilary  subtest  or  vocabulary  items  intermingled 
among  other  kinds. 

Just  as  there  are  more  ways  to  kill  a  cat  than  by 
choking  it  with  butter,  there  are  more  ways  to  measure  a 
person's  vocabulary  than  by  putting  him  in  a  conversational 
group  and  seeing  how  meuiy  people  he  can  out-talk  or  by 
counting  the  number  of  people  over  vhcee  heads  he  can  talk! 
Standardized  paper-and -pencil  tests  are  a  much  better  wcy . 

And  even  these  csui  tsUie  many  forms.  Verbal  analogy  items. 
Items  calling  for  words  opposite  in  meaning  to  given  words, 
items  calling  for  synonyms,  and  items  calling  for  matching 
a  word  with  a  definition  have  all  been  vised.  Saoiples  of 
some  popular  types  of  vocabulary  items  shown  below, 
a.  Verbal  analogy  items 

Item  1.  "Place"  is  to  "time"  as  "point"  is  to 

A.  hour 

B.  minute 

C.  moment 

P.  eternity 

E.  now  (The  answer  is  C. ) 
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b. 


Item  2.  Band:  gauntlet:  svord: 

A. ,  attack 

B.  armor 

C.  shield 
0.  spear 
E.  sh^th.. 


(The  answer  Is  E.) 

Opposites  Items  (emtonym  Items) 

Directions:  Qioose  the  word  that  is  Qost  ne^ly 


Item  3. 

opposite  In  meauilng  ' 

Hope 

A. 

. Dislike 

B. 

Despair 

C. 

Wish 

D. 

Fail 

E. 

Criticize 

(The  answer  is  B.) 

Synonym  items 

Directions:  Choose  the  word  that 

Item  4. 

the  same  meemlns  as  ' 

Apparel 

A. 

Appearance 

B. 

Illvuslon 

C. 

Luggage 

D. 

. Clothing 

E. 

. Elegance 

Item  3. 

(The  answer  Is  D.) 

,  Itystlfy 

A. 

Cheat 

B. 

,  Puzzle 

C. 

■  Vaporize 

D. 

Scent 

E. 

Enlarge 

(The  answer  is 


d.  . SasM-opposlte  items 

Directions:  Be«h  item  consists  of  four  words.  Find 
the  two  that  are  most  nearly  the  same 
in  meaning  or  opposite  in  meanlDg. 
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Item  6 

A.  Adjust 

B.  Admit 

C.  Adapt 

B.  Adept 

Item  7 

A.  Exotic 

B.  Superficial 

C.  Ingrained 

D.  Excellent 

(The  answer  to  Item  6  Is  A  and  C, 
and  to  Item  7  1b  B  and  C,) 

e.  Definition  Items 

Item  8«  Suffrage  -IS  the  rlgtht  to 

A.  petition...  !  i 

,B.  vote.” 

C.  assemble. 

D.  worship. 

E.  work. 

(The  answer  is  B.) 

These  varied  item  types  all  give  quite  similar 
results.  It  is  true  that  the  verbal  emalogy  type  of  item 
(and  to  a  lesser  extent  the  same-opposite  type)  may  involve 
a  little  more  reasoning  ability  them  some  of  the  other 
types,  but  even  so,  ^diat  emy  of  them  measures  is  mostly 
vocab\ilary. 

5.  Identification  of  illiterates  and  persons  with 


severe  reading  disabilities.  Among  the  items  in  the  In¬ 
formation  subtest  of  the  Army  Alpha  were  some  extremely 
easy  ones,  that  had  been  put  in  for  the  purpose  of  screen¬ 
ing  illiterates.  For  instance  there  was  em  item  testing 
knowledge  of  the  fact  that  it  is  more  likely  to  snow  in 
the  winter  than  in  the  summer;  and  an  item  testing  knowl¬ 
edge  of  the  fact  that  eggs  come  from  hens.  Other  tests, 
too,  have  contained  very  easy  items  to  insure  that  anyone 
who  co\ild  read  and  write  coxxld  get  better  them  a  zero  score. 
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usual  procedure  has  heen  to  Incorporate  these  extra-easy 
items  vlth  the  Items  of  normal  difficulty  in  a  single  scoi«. 
It  has  not  been  customary,  however,  to  obtain  a  separate 
score  on  the  extra-easy  Items,  which  Is  the  procedure  that 
was  followed  on  Project  Talent,  In  an  effort  to  Identify 
students  idiose  reading  skills  are  so  lnadeq;uate  that  their 
scores  on  the  rest  of  the  Information  Test  and  on  other 
tests  in  the  battery  would  be  invalidated  by  failure  to 
coaqprehend  the  items. 

6.  Measiures  of  motivational  factors*  .A  poor  score  on 
items  that  .are  so  easy  that  anyone  \iho  can  read  and  write 
shovild  get  a  perfect  score  usually  indicates  either  illit¬ 
eracy  or  else  a  severe  reading  disability  characterized  by 
abnormally  slow  reading  or  by  grossly  Inadequate  compre¬ 
hension  of  idiat  is  read.  If  these  explanations  of  the  poor 
score  on  extra-easy  items  do  not  fit,  the  next  more  probable 
alternative  explanation  is  that  the  attitude  of  the  person 
taking  the  test  leaves  much  to  be  desired.  In  this  event 
the  low  score  may  be  due  to  flippancy  (manifested  by  delib¬ 
erately  marking  the  wrong  answers)  or  to  apathy  and  indiffer¬ 
ence  (resulting  in  lackadaisical  behavior  in  marking  the 
euiswers) . 

!Qius  the  same  items  that  eure  used  to  spot  llluterates 
and  "non-readers"  may  also  be  used  to  spot  those  whose  scores 
do  not  do  Justice  to  their  abilities  because  of  sui  inappro¬ 
priate  attitude  toward  the  tests  or  because  of  an  unusual 
proneness  to  clerical  errors.  This  is  quite  a  large  nuia>er 
of  possible  explanations  for  a  single  low  score.  /Obviously 
the  low  score  does  not  cone  with  a  label  attached  to.  t'ell< 
which  is  the  right  explanation  in  the  given  case.  It  is 


expected,  however,  that  reasonably  accurate  Inferences  can 
be  drawn  on  the  basis  of  the  entire  pattern  of  t^e  student ' s 
scores  on  the  rest  of  the  tests. 

7.  Measures  of  scientific  attitude.  There  are  no 
clear  historical  antecedents  for  Interspersing  Items  de¬ 
signed  to  measure  scientific  attitude  among  Items  of  an 
information  test.  This  Isoone  Of  the  Scales  In  tfie  Project 
Talent  test  battery  that  are  experimental  In  nature. 

■  Description  of  the  Talent  Information  Test 

1.  General  characteristics.  The  Information  Test  nf 
the  Talent  Battery  consists  of  395  Items.  All  of  these 
items,  with  the  exception  of  the  ten  comprising  the 
Scientific  Attitude  8C8j.e,  are  clearly  "Information  it«ns"; 
In  other  words,  they  test  possession  of  factual  knowledge. 
The  ten  scientific  attitude  Items  probably  represent  a 
conposite  of  information,  attitude,  euod  Jud^ent.  Almost 
all  of  the  395  items  are  very  brief. 

As  has  been  Indicated,  the  Information  Test  was  divided 
into  two  parts  on  the  basis  of  whether  subscores  were  to  be 
punched  on  the  scoring  machine  or  specific  Item  responses 
on  the  document  reader.  Sixteen  scores  were  obtained 
initially  for  each  student — 15  subscores  in  Part  I  and 
their  sum  (the  Part  I  total) — but  potentially  the  test  can 
yield  a  very  large  number  of  additional  scores,  since  the 
Itons  for  which  Individual  responses  were  punched  (the  Fart 
II  Items)  can  be  combined  and  reoonblned  in  any  way  desired 
and  can  slLso  be  combined  In  any  way  with  any  of  the  sixteen 
Fart  I  scores.  Ihus  secLLes  can  be  tailor-made  for  specific 
pxirposes,  such  as  predicting  success  In  a  particular  occu¬ 
pational  area.  The  tailor-made  scale  would  combine  whatever 
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Items  are  best  for  the  specific  purpose. 

Table  YII*'!  shovs  the  nuober  of  Itesis  of  each  kind. 


The  time  limit  allowed  vas  as  guierous  as  admlnlstrativa 
considerations  would  permit,  so  that  almost  averyone  would 
have  time  to  finish.  Within  the  two  parts  the  iteaui  were 
arranged  in  a  TOughly  "spiral"  order  (l.e.,  the  different 
Iclnds  of  items  were  Intezmingled  sqpparently  randomly  but 
actually  in  a  roughly  cyclical  arrangement).  The  arrange¬ 
ment  of  items  was  subject  only  to  certain  minor  limitations 
in  Paz^  I,  imposed  by  the  req,ulrements  of  the  scoring  machine 
and  by  the  desirability  of  conforming  at  least  approximately 
to  a  priori  specifications  concerning  the  specific  locations 
of  the  Screening  items.  (The  reasons  for  these  a  priori 
specifications  are  discussed  later  in  this  chapter  0 
!Ihe  following  sure  a  few  sample  items  for  this  test 
that  .would  fall  in  the  miscellaneous  category  (category  38 
in  Table  YH-l) . 

Item  9.  In  the  song  that  starts  "Hy  country,  'tis 
of  -ttiee", .  the  next  line  is 

A.  Of  thee  I  sing. 

B.  Author  of  liberty. 

C.  Sweet  land  of  liberty. 

D.  Protect  us  by  niy  might. 

S.  Our  fathers'  God,  to  Thee. 

(The  answer  is  C.) 

Item  IQ.  .Pulitzer  Prizes  are  awarded  for  .all  of 
the  following  except 

A.  contributions  to  science. 

B.  biographies. 

C.  plays. 

S.  novels. 

.1.  news  pbotogn^hs  . 


(The  answer  is  A.) 
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Item  11.  The  best  known  British  humor  magazine  Is 

Whaty-Hb! 

B.  Last  Lau^. 

C.  .Cheers. 

O.  Xing '  8  English . 

E.  Punch. 

(ibe  answer  Is  E.) 

On  the  basis  of  evidence  obtained  from  the  use  of 
genez^  Information  tests  in  the  past,  there  Is  good  reason 
to  expect  the  total  score  on  the  Project  Talent  Information 
Test. to  prove  useful  as  a  predictor  of  college  success. 

Vocab\ilary  Scale 

^is  consists  of  Items  of  the  Information  Test  that 
provide  a  measure  of  the  student's  genersa  vocabulary.  This 
concept  of  "general  vocabulary"  probably  requires  explematlon. 
•Although  the  distinction  between  "general"  vocabuleucy  and 
"technical"  or  "specialized"  vocabulary  is  not  a  precise  one, 
general  vocabulary  esai  be  considered  to  consist  of  words 
that  might  reasonably  be  in  the  vocabulary  of  well  educated 
persons  whether  they  have  had  specialized  training  In  a 
particular  area  qr  not. 

For  insteuice.  It  would  not  be  unreasonable  to  Include 
items  such  as  the  following  In  the  test: 

Item  12.  Which  of  these  objects  is  usually 
spherical? 

A.  A  water  glass 

B .  An  orange 

C.  A  dovighnut 

D.  A  dime 

E.  A  cone 

(The  euiswer  is  B.) 

Itm  13.  The  government  of  the  Ibxlted  States  is 
called  "federal"  because  it  has 

A.  a  President. 

B.  three  separate  branches. 

C.  free  elections. 

D.  separate  states. 

E.  sepeuratlon  of  Church  and  State.  (The  answer  is  B.) 
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Item  l4-»  .  Another  word  meaning  ’’vapor”  Is 


A.  water. 

.  B.  eu. 

C.  liquid. 

0.  condensation. 

E.  solid. 

(^e  answer  is  B.) 

These  three  items  test  idiether  i^e  stvident  knows  the 
meaning  of  ”spherlcal”,  "federed” , .  and  ’’vapor” .  Ihese 
terms  represent  concepts  from  the  areaa  of  mathematics; 
social  st\idles;  and  physical  science  respectively;  but  they 
are  nevertheless  terms  which  it  is  reaaonable  to  consider 
as  part  of  a  person's  general  vocabulary.  Inclusion  of 
items  on  words  such  m  "siherlcal";  ’’federal”,  and  "vapor" 
is  one  way  (a  relatively  minor  way,  perhaps,  but  neverthe¬ 
less  one  that  ml^t  have  interesting  results)  in  ^Ich  the 
Talent  Vocabulary  scaile  differs  from  many  widely  vised  vocab- 
uleoy  tests,  a  nvunber  of  vrtxich  appeeur  to  be  limited  to  words 
of  a  rather  "litersuy"  character.  Thovagh  the  Talent  Vocab¬ 
ulary  scale  represents  a  wider  range,  note  how  words  it 
mi^t  Include,  like  ’’sphericetl",  "federal",  and  "vapor", 
contrast  with  the  following  terms,  >dilch  are  far  more 
highly  specialized: 

Mathematics  terms:  "binomial",  "apothem" 

Social  studies  terms:  "pocket  borou^",  "fief" 
Physical  science  terms:  "halogen",  "ohm" 

Items  testing  knowledge  of  the  meanings  of  any  of  these 
six  terms  could  legitimately  go  in  the  appropriate  subject- 
matter  scale  (mathematics  or  social  studies  or  physical 
science)  but  not  in  the  Vocabulary  scale.  The  reason  that 
inclusion  of  specialized  technical  vocabulstiy  would  be 
undesirable  is  that  in  most  cases  knowledge  of  such  terms 
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nay  depend  far  more  on  specialized  training  In  a  certain 
area  than  on  general  level  of  vocabulary. 

Nov  let's  get  back  to  San^le  Items  12,  l3j  and  l4  above. 
It  will  be  noted  that  not  all  of  them  are  of  the  traditional 
vocabvilary  item  fb^,  caJ-llng  for  a  synonj/ta  or  definition. 
Item  l4  does  cadi  for  a  synonym  but  Items  12  auid  13  test 
conqprehension  of  the  words  "spherlcad"  and  "federad"  some- 
diat  less  directly,  (if  the  student  knows  what  "spherical" 
means  It  Is  reasonable  to  assvme  he  also  knows  diat  an 
orange  looks  like  amd  that  he  wovdd  therefore  know  that,  cm 
biange  Is  spherical.  Similarly,  if  a  student  understands 
the  concept  represented  by  the  word  "federal"  he  can  answer 
Item  13.)  The  recognition  that  con^rehenslon  of  a  word  ceui 
be  tested  indirectly,  that  there  is  no  partic\ilar  merit  in 
limiting  the  Vocabulary  scale  to  items  calling  for  synonyms 
or  formal  definitions,  results  in  a  better  test.  Its  merit 
lies  in  the  fact  that  it  permits  phrasing  the  items  in 
diatever  seems  like  the  most  promising  way  of  determining 
vdiether  the  student  understands  the  concept  being  tested 
and  Aether  his  degree  of  understanding  is  at  a  suitable 
level  of  specificity.  (Deciding  the  appropriate  level  of 
specificity  at  idxleh  to  pitch  an  item — the  specific  point  to 
test  for — is  a  matter  which  inevitably  involves  an  element 
of  Judgment.  In  the  case  of  the  word  "spherical",  for  in¬ 
stance,  the  point  to  test  would  be  whether  the  stiident  knows 
fdiat  something  that  is  s^dnerlcal  looks  like;  since  we  sure 
avtpposlng  it  Is  to  be  regarded  as  a  general  vocabulary  item, 
not  a  Bathematlcs  lt«B,  there  would  be  no  polht  at  all  in 
finding  out  whether  the  student  knows  the  formal  definition 
that  a  sphere  is  a  surface  formed  by  all  points  at  a  given 
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distance  from  a  given  point.) 

The  Vocabulary  score  is  Intended  to  measure  ability  to 
comprehend  vords.  It  is  not  Intended  to  measure  "recall"  of 
vocabulary— l.e.,  the  ability  to  select  and  use  the  appro¬ 
priate  word  to  express  one's  meaning.  In  line  with  the  pur¬ 
pose  of  the  testj  to  measure  the  ability  to  coaprehend  the 
writing  of  others  rather  than  the  ability  to  express  oneself 
in  writing^  "understanding  of  a  word  meaning"  is  considered 
to  mean  understanding  at  a  fairly  gross  level. 

Very  fine  differentiations  in  meanings  and  Isqpllcatlons, 
which  are  more  a  matter  for  the  master  stylist  in  English  than 
for  the  "Jovimeyman  users"  of  the  language^  are  not  a  matter 
of  concern.  Thus^  although  the  dictionary  indicates  a  sll£^t 
difference  in  implication  between  "questionable"  euid  "doubtful" 
(e.g.^  when  \i8ed  as  the  final  word  in  the  sentence:  "His 
honesty  is  .") .  the  meanings  are  sxifflciently 

similar  that  for  purposes  of  this  test  the  two  words  ceui  be 
considered  synonymoiis .  For  instance,  the  following  item 
would  be  acceptable: 

Item  13.  "(^lestionable"  means 

A.  .  inq,ulrlng. 

B.  doubtful. 

. C .  inquisitive . 

0.  true . 

E.  false.  (The  answer  is  B.) 

A  further  point,  \dxlch  perhaps  may  seem  self-evident, 
is  that  the  test  is  concerned  with  written  Ehgllsh,  not  with 
spoken  Ehgllsh.  The  fact  that  a  person  knows  the  answer  to 
a  certain  question  means  that  he  understands  the  word  Mbsa 
he  encoTinters  it  in  a  written  fozm,  but  this  is  ik)  guai^tee 
that  he  will  luiderstand  it  in  its  spoken  form.  There  is  a 
possibility  that  he  won't,  particularly  if  the  word  is  one 


VII-19 

'which  Is  pronounced  q;uite  differently  from  the  vay  Its 
spelling  would  suggest-* "indict",  for  Instance ^ 


A 


.Scales  to  Measure  Information  in  Specif Ic  Areas 

In  discussing  those  scales  we  shall  divide  them,  purely 
as  a  matter  of  convenience,  into  "eu:edemlc''  subject  matter 
eureas  and  "non-academic"  areas,  but  it  should  be  borne  in 
mind  that  this  distinction,  as  it  applies  to  the  test,  is 
a  somewhat  arbitrary  one,  since  coverage  includes  both 
things  lesurned  In  school  and  things  that  may  have  been 
learned  outside  of  school,  throu^  independent  reading, 
radio,  television, . auid  other  available  sources. 

■  Academic  are€U3.  Under  this  heeuUng  are  included  those 
areas  which  constitute  the  major  portion  of  the  typicall 
academic  curriculum  in  hi^  school. 

The  general  purpose  of  these  subscores  is  to  measure 
acquisition  of  information  in  the  area  in  question.  An 
effort  was  made,  therefore,  to  aaniple  the  field  as  broadly 
as  was  feasible  with  relatively  few  items. 

1.  Literature .  The  purpose  of  this  scale  is  to 
measure  familiarity  with  the  world  of  literature.  The 
chief  "common  body  of  literature"  to  which  a  sizable  pro¬ 
portion  of  the  group  tested  la  likely  to  have  been  exposed— 
apart  from  the  nursexy  rhymes  and  fairy  tales  of  the  pre¬ 
school  age— is  the  body  of  literature  which  is  either  re¬ 
quired  reading  in  school  or  is  on  school-issued  lists  of 
recommended  reading. 

No  two  lists  of  required  or  recoomended  reading  issued 
by  schools  or  school  systems  are  identical.  In  fact  it  is 
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probable  that  euiy  two  such  lists,  would  differ  considerably 
in  detail— not  only  In  regard  to  the  grade  level  at  idilch  a 
certain  book  Is  placed  but  .  aOLso  In  regard  to  ^Aether  certain 
books  eure  Included  at  eC.1.  This  being  the  case,  there  Is  no 
one  list  or  group  of  books,  amd  probably  not  even  any  single 
book,  that  would  be  recommended  or  required  reading  for  all 
students.  However,  a  broad  coverage  makes  It  likely  that 
students  \Ao  have  eusqulred  the  habit  of  ree41ng  will  get 
reasonably  good  scores — at  least  If  their  reading  Is  of 
materials  above  the  level  of  comic  books  and  Is  not  limited 
to  purely  expository  material  such  slb  "HOw  to  Build  a  HI -PI  ; 
Set". 

In  developing  the  literature  scale,  a  systematic  effort 
was  made  to  Insure  that  both  poetry  eind  prose  were  well 
represented  said  further,  that  there  was  adequate  represen¬ 
tation  of  both  children's  literature  (e.g.,  "Treasure  Island", 
"Robin  Hood",  etc.),  and  literature  that  Is  considered  suit¬ 
able  for  adults  as  well  eis  adolescents.  Many  of  the  Items 
test  knowled^  of  some  salient  point  that  would  be  fo\md 
chleflj’-  by  reading  the  literary  work  In  question  rather  than 
by  merely  reading  about  It.  In  this  category  are  Items  about 
characteristics  of  principal  charswjters.  Items  about  plot, 
etc.  .An  effort  was  meuie,  however,  to  avoid  Items  about 
trivial  or  obscure  points  (minor  Incidents,  unliiq)ozi:cuit 
cheu^cters,  etc.).  Items  about  specific  works  of  literature 
are  svqpplomnted  by  Items  that  test  additional  kinds  of  In- 
fozmatlon  (e.g.,  the  meaning  of  such  terms  as  "blank  verae"). 


nie  following  are  sample  Items: 
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Item  l6.  Each  line  of  blank  verse  has  , 

A.  6  feet. 

B.  10  feet. 

C.  3  feet. 

B.  ^  feet. 

E.  5  feet. 

(The  answer  is  E.) 

Item  17.  Othello's  motive  for  murder  mas 

A.  self-defense. 

B.  jealousy. 

C.  fear. 

D.  craving  for  power. 

E.  greed  for  gold. 

(The  ansTTer  is  B. ) 

Item  l8.  Which  of  these  was  a  knight  of  King 
Arthur's  Rovmd  Table? 

A.  Alfred 

B.  Lancelot 

C .  Merlin 

D.  Ivanhoe 

£.  Roland 

(The  answer  is  B. ) 

2)  Social  studies.  This  scale  covers  facts  and  con¬ 
cepts  from  the  fields  of  history,  economics,  government  and 
civics,  geography,  current  affairs,  etc.  At  least  half  of 
the  history,  government,  and  geography  items  are  concerned 
with  the  United  States,  but  there  is  coverage  of  the  rest  of 
the  world  too.  Social  studies  content  tau^t  in  elementary 
school  has  been  sampled,  as  well  as  that  taught  in  high 
school. 

The  8aiig>llng  of  material  on  United  States  history  and 
government  Includes  some  coverage  of  periods  from  the  dis¬ 
covery  of  America  to  the  present.  Political,  economic, 
industrial,  and  military  history  were  scuopled.  In  regard  to 
the  coverage  of  non-U. S.  history,  the  items  are  chiefly  con¬ 


cerned  with  the  history  of  the  Western  world.  It  was  fe.lt 
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that  the  history  of  the  Orient- -at  least  Its  hlstoly  In  re¬ 
gard  to  natters  which  have  not  imj^nged  directly  on  the  West, 
and  certainly  its  history  in  the  eras  preceding  its  opexiing 
to  Western  Influence — is  so  little  taught  and  so  little 
known  that  items  on  such  natters  would  he  too  dlffj.cult  to 
contribute  a  worthwhile  degree  of  reliable  information  to 
the  test  scores. 

Items  that  are  likely  to  become  dated  within  20  years 
or  whose  significance  is  likely  to  change  markedly  within 
that  period  were  kept  to  a  ninlmum.  However,  this  did  not 
wholly  preclvide  items  on  topics  of  current  concern.  Some 
situations  which  have  recently  been  very  much  in  the  public 
eye  will  probably  be  natters  of  continuing  interest  and  con¬ 
cern  for  a  long  time. 

Both  vocabulary  items  and  items  testing  other  kinds  of 
information  are  included. 

Materisds  not  necessarily  taught  in  high  school  are  not 
rigidly  excluded  from  the  test,  since  it  is  felt  that  ac¬ 
quisition  of  knowledge  about  such  materials  through  voluntary 
reading  or  In  other  ways  indicates  special  Interest  in  the 
area.  The  following  are  senile  items: 

Item  19.  Which  of  these  is  specifically  required 

by  the  U,  S.  Constitution? 

A.  Supreme  Court 

B.  PbllticeQ.  parties 

C.  Congressional  ccnnittees 

D.  Ncminating  ccniventions 

£.  Cabinet 

(The  answer  is  A.) 
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Item  20.  Which,  of  thCae  coiuitrleB  has  more  than 
one  native  lang^KfieT 

A.  France 

B;.  Greece 

<  0.  Italy 

S.  3irltiKrland 
United  States 

(^n^e  answer  la  B.  ) 

Iten  21.  Kajbleon  was  emperor  of  France  around 
the  beginning  of  the 

Ai  15th  century. 

B.  16th  century. 

C.  17th  century. 

D.  18th  centtiry. 

K.  19th.  century. 

(The  answer  Is  E.) 

3)  Mathematics.  The  area  of  mathematics^  unlike 
other  academic  subject  matter  areas.  Is  represented  In  the 
iSalent  battery  not  only  In  the  Information  Test  but  in  the 
following  other,  tests  as  well: 

a)  Arithmetic  Computation  Test 

b)  Ifethsmatics  Test 

Fart  I.  Arithmetic  Reasoning 
Bart  II.  1  Introductory 
Fart  III .  Advanced 

However,  the  mathematics  items  In  the  Information  Test  do 
not  overlap  the  content  of  these  other  tests  since  the  In¬ 
formation  Test  Items  are  concerned  with,  knowledge  of  facts, 
not  with  the  possession  of  mathematics  skills.  Bo  Informa¬ 
tion  Test  items  require  con^iiutat Ion.  (This  is  covered  in 
the  Arithmetic  Conoputatlon  Test . )  Ho  Information  Test  Items 
require  reasoning  or  problmaR solving.  (^Qils  Is  covered  in 
the  Nathemetlca  Test.)  Hearly  half  of  Items  are  on 
topics  ccnrered  In  Grade  9  or  earlier^  and  the  others  are 
concerned  with  topics  that  are  not  usually  touched  upon 
uuitll  at  least  the  ICth  grade. 
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Bone  items  <m  Ixifonsstioai  that  aight  b«  acfoire^  in 
other  vsys  than  thTO\i,{^  formal  instxtmtloii  in  mathematics 
vere  included  since  it  mas  felt  that  such  information  mic^ 
Indicate  special  Interest  in  mathematics.  (An  exsaiple  of 
such  Informatian,  not  generally  included  in  the  hic^  school 
mathematics  currlculim,  is  the  impossibility  of  trisecting 
an  angle  by  Euclidean  means. }  Die  history  of  mathematics 
was  not  included^  hovevor. 

Within  the  limitations  imposed  above,  the  items  sampled 
the  field  as  broadly  as  seested  feasible. 

Both  vocabulary  items  and  Itesis  testing  other  kinds  of 
Information  vere  included.  Among  the  kinds  of  content 
sampled  vere  such  matters  as  definitions,  the  vocabulary  of 
mathematics,  conventions  of  mathematical  notation,  and  the 
understanding  of  concepts  (e.g.,  fractions,  decimals,  per¬ 
centage,  factors,  equations,  planes,  angles,  logarithms, 
e:q;K3nent8,  etc.). 

Sample  items  follow: 

Item  22.  "5b  +  2^  =  5"  is  called 

A.  a  coefficient. 

B.  an  equation. 

C.  a  fozmila. 

D.  an  unknown. 

E.  an  identity. 

(!Ihe  answer  is  B.) 

i 
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Item  23.  An  ordinary  slide  rule  is  designed  for 

A.  co!aputing« 

B.  measuring  length. 

C. ..  measuring  angles. 

B.  velf^ing. 

E.  reading  tables. 

(The  snswer  is  A.) 

4.  Physical.,  science.  Ihls  seale  Includes  items  from 
the  areas  of  chemistry^  physics,  astronomy,  and  other 
physical  sciences . 

^lenoe  topics  taught  in  elementary  school  are  Included, 
as  well  as  those  not  studied  until  hie^  achool.  Both  vocab¬ 
ulary  items  emd  items  testing  other  kinds  of  information 
were  Included.  .  Items  on  information  that  might  readily  be 
acquired  in  other  ways  than  through  formal  instruction  in 
science  were  Included  since  it  was  felt  that  acquisition  of 
such  knowledge  thro\igh  vclvintary  reading,  experimentation, 
or  in  other  ways  would  indicate  special  Interest  in  the  area. 
Sample  items  follow: 

Item  24.  Ozone  is  a  form  of 

A.  electricity. 

B.  air. 

C.  oxygen. 

D.  nitrogen. 

E.  carbon  dioxide. 

(The  answer  is  C. ) 

Item  25.  Gravitation  is  the  force  idilch  causes  a 

rubber  ball  to 

A.  bounce. 

B.  go  flat. 

C.  keep  its  shape. 

D.  fall  idien  dropped. 

E.  change  shape  when  pressed. 

(The  answer  is  S.) 


Item  26.  A  "light  year"  is  a  \iiilt  of 


A.  tenq^rature. 

B.  volume. 

C.  brl{^tnes8. 

B.  . distance. 

■  E.  speed. 

.  (^e  axusver  Is  D. ) 

5*  Biological  science.  Ihis  spale  includes  items 
from  the  fields  of  botany^  zoology^  cmd  microbiology. 

Items  about  nature  lore  are  Included,  as  well  as  items 
concerned  with  the  more  formal  aspects  of  biological  science 

Both  vocabulary  items  and  items  testing  other  kinds  of 
information  are  Included. 

A  sample  item  follows: 

■  Item  27.  The  substance  ^dxich  makes  plants  green  la 

6 

A.  cellulose. 

B.  starch. 

C.  chlorophyll. 

0.  sap. 

E.  fvtng\:is. 

(The  answer  is  C.) 

Other  Areas 

Reference  to  Table  VII-l  shows  the  many  kinds  of  in¬ 
formation  covered,  besides  those  in  areeus  taught  eus  part  of 
the  typical  CMsademlc  curriculum  in  hlcd^  schools. 

In  developing  these  items,  an  effort  was  made  to  in¬ 
clude  some  that  would  givai  an  advantage  to  those  who  had 
paxtlclpated  ih:  the  activity  in  question  as  a  hobl^  or 
voluntary  extra-curricular  activity  (e.g.,  electronics, 
cazrentry,  mechanics,  cooking,  sewing,  photography,  sports, 
theater,  ham  radio,  music,  art,  Joxmiallsm,  chess,  other 
games,  etc.).  Other  items  were  designed  to  give  an  ad¬ 
vantage  to  those  who  had  peurtlclpated  in  the  sustlvlty.  as  a 
household  chore  (e.g.,  cooking,  geying,  baby  care,  home 


raalntenance  and  minor  repairs,  farm  chores).  ^ Still  -other 
items  were  intended  to  give  an  advantage  to  those  vho  had 
participated  in  the  activity  in  question  throui^  a  part-time 
or  summer  Job  (e.g.,*  baby-sittixig,  office  Jobs,  etc.).  Some 
items  G^ve-aa  advantage  to  those  vho  have  dme  extrao\irrloulsr 
reading  vhich  has  a  direct  or  indirect  bearing  on  the  aaNM  ih'' 
-question  (a. g.,  engineering,  arohitMturh,  law,  medicine; 
aaronantiea  and  space,  photography).  Items  are  also  inaludad 
that  give  an  advantage  to  those  vho  have  had  ioma  other  form 

t 

of  special  training  or  education. 

Some  of  the  characteristics  of  specific  scales  or  s\ib- 
sets  of  items  follow.*  ^ 


*llqte  that  three  scales.  Aeronautics  and  Space,  Electricity 
and  Electronics,  and  Mechanics,  because  of  their  major  im¬ 
portance,  are  discussed  separately,  following  the  discussion 
of  the  Information  Test. 


1..  Music.  While  these  items  certainly  are  not  indic¬ 
ative  of  musical  talent, .  those  \dio  enjoy  going  to  concerts 
and  opexvi  or  listening  to  music  on  the  radio  and  phonograph 
should  have  aii  advantage  on  thia  qot  .of  .items  -(e:u:Bpt' pejchapo 
If-litheit  intetefit^da  StriCtlylvIil  ;.ilted  tQ.-ro&l^and-roll) . 

.  Here  is  a  sasqjle  item:  ' 

Item  28.  Who  wrote  "Peter  and  the  Wolf"?  ' 

A.  Prohofieff 
■  B.  Bach 

C.  TSchaikovsky 

D.  Dukas 

B.  Nosart 

(!lha  answer  is  A.) 

>• 

2.  Art.  This"  scale  smasures  knowladge  about  art.  This 
knowledge  may  be  acquired  throu^  pai^elpating  in  art  as  a 
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hobby  or  recreational  activity  or  in  other  wye .  .  Oioae  lAo 
enjoy  going  to  miaeums  and  art  galleries,  reading  about  art, 
and  perhaps  dabbling  a  little  in  it  :theBMielves  should  have 
an  advantage  on  these  items^oas  should  those  idio  have  had 
special  training  in  art.  Hoyever,  there  is  absolutely  no 
reason  to  think  that  this  scale  will  identify  those  with 
creative  talents  in  art. 

Two  sample  items  follow: 

Item  29.  Easels  are  used  by 

A.  .soulptors. 

B.  mx|8lolans. 

C.  surgeons. 

D.  lawyers. 

E.  painters. 

(!Qie  answer  is  E.) 


Item  30.  Which  of  these  is  not  the  name  of  a 
famous  painter? 

A. ,:.  Titisui 

B.  Rubens 

C.  Cezanne 

D.  Hapoli 

E.  Van  Byck 

(The  answer  is  D.) 

3.  Home  Economics.  These  items  should  give  an  advantage 
to  students  >dio  have  engaged  in  relevant  activities  (cooking, 
sewing,  etc.)  as  a  household  chore  or  because  they  enjoy  them, 
those  idio  have  engaged  in  relevant  activities  as  a  part-time 
Job  (e.g,,  bahy-sittlng) ,  and  those  ^o  have  tsiken  home 
economics  courses. 

A  saiQile  item  follows: 

Item  31.  In  a  recipe  calling  for  one  cup  of  butter, 
you  should  use 

A.  one  pound. 

B.  two  pounds. 

C.  a  haCLf -pound. 

D.  a  quarter-povind.  ^ 

E.  one-ei^th  povind.  (The  anst^  is  C.) 


4.  Lav.  While  these  items  primarily  measxirr  a  kind  of 
"general  info?^  ''*ion",  so  that  a  good  score  on  this  scale  is 
not  necessarily  indicative  of  paurticnlar  interest  in  this 
fields  it  nevertheless  seems  likely  that  a  student  ^ose  score 
in  this  area  is  relatively  low  is  not  likely  to  have  ehou^ 
interest  in  lav  to  make  it  an  advisable  career  for  him. 

Here  are  two  sample  items: 

Item  32.  What  kind  of  degree  do  most  lawyers  have 
from  law  school? 

A*  H.A. 

H.  H.S. 

C.  Ph.D. 

D.  XjL.L. 

E .  LL.B. 

(The  answer  is  E.) 

Item  33.  A  coroner's  chief  function  is  to 
investigate 

A.  mysterious  deaths. 

B.  biirglaries. 

C .  counterfeiting  rings . 

D.  kidnapping  cases. 

E.  accusations  of  bribery. 

(The  answer  is  A.) 

5.  Medicine.  Areas  sampled  include  knowledge  of 
physiology,  nutrition,  first  aid,  common  ailments,  physiclanc' 
Instruments  (e.g.,  stethoscope),  training  requirements  for 
careers,  etc. 

Here  is  a  sample  item: 

Item  34.  A  deficiency  disease  is  a  disease  caused  by 

A.  a  virus. 

B.  i:4>roper  diet. 

C.  not  getting  inoculated. 

D.  defective  glands. 

E.  poor  heredity. 

(The  answer  is  B.) 

6.  Architecture.  Those  who  have  reeul  books  and  articles 
about  architecture,  euad  students  whose  interest  has  manifested 
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Itself  in  other  vays— for  instance,  those  vbo  have  been  un¬ 
usually  observant  in  regard  to  the  architecture  all  around 
the*-^ho\ild  do  uell  on  these  items. 

7.  Farming.  These  items  are  intended  to  give  aome 
representation  to  the  kinds  of  special  information  that 
children  vho  grov  up  on  farms  or  ranches  are  likely. to 
acquire.  The  items  might  give  some  advantage  to  those  vho 
have  an  Interest  in  these  aspects  of  rural  life. 

8.  Theater.  These  items  should  be  indicative  of  ah 
Interest  in  the  theater,  (it  is  soaevbat  doubtful,  hovever, 
that  it  is  possible  to  get  much  differentiation  between 
those  idio  are  interested  in  the  stage  as  a  career  emd  those 
^o  merely  are  Interested. as  spectators.)  Most  of  the  items 
deal  with  theater  terms  (e.g.,  grease-paint,  footlights, 

etc  • ) . 

Here  Is  a  saii^le  item: 

Item  35.  An  ingenue  role  in  a  play  usually  calls 
for; 

A.  exceptional  acting,  ability. 

B.  great  beauty. 

C.  youthfulness. 

D.  a  sophisticated  manner. 

.E.  skill  as  a  comedian. 

(The  emswer  is  C.) 

9.  Photography.  These  items  should  test  information 
that  is  acquired  prlnclpstUy  through  having  photography  as 
a  hobby,  taking  pictures,  processing  them,  and  also,  to  a 
certain  extent,  through  reading  about  photogmphy,  attending 
eidilbits,  and  sauaifesting  Interest  in  other  ways. 

Screening  Scale 

The  primary  purpose  of  the  Screening  items  is  to 
identify  those  students  ^ose  reading  disability  is  so 


severe  that  their  scores  on  certain  other  tests  are  auto¬ 
matically  Invalidated. 

Certcdn  tests  of  the  battery  In  addition  to  the  Beading 
Ccmqprehenslon  test  have  a  high  enough  verbal  content  that 
scores  on  them  vlll  be  affected  by  gross  residing  disability. 
(Among  these  teats  sure  Information,  Arithmetic  Beasonlng, 
Mechsmlcal  Reasoning,  Creativity,  EUid  liable  Reading.)  The 
three  Inventories  (Student  Activities  Inventory,  Interest 
Inventory,  and  Student  Information  Blemh)  yill  also  be  af¬ 
fected.  The  primary  purpose  of  the  Screening  Scale  In  the 
Information  Test  is  to  Identify  students  idiose  scores  on  the 
tests  named  are  questionable  because  of  lEu:k  of  ability  to 
reeui  well  eno\igh  to  congjrehend  the  questions.  A  secondary 
purpose  is  to  identify  those  students  who,  though  they  can 
read  adequately  well,  do  not  obtain  scores  ^rtilch  reflect 
their  true  ability,  either  because  of  a  tendency  to  make 
numerous  careless  mistakes  of  a  clerical  aat\u‘e  (such  as 
accidentally  marking  an  answer  space  other  than  the  Intended 
one)  or  because  of  an  unfavorable  attitude  toward  the  test- 
tedslng  situation.  An  unfavorable  attitude — reflecting 
faulty  motivation  in  regard  to  the  battery- -might  be  mani¬ 
fested  in  the  form  of  either  apathy  or  flippancy,  (it 
should  be  noted,  however,  that  some  students  might  make  the 
flippant,  deliberately  Incorrect  response  only  in  the  case 
of  the  screening  items  end  other  extremely  easy  items.) 

Those  with  a  low  screening  score  will  fall  into  several 
categories,  as  follows: 

a.  Non-readers 

(l)  By  far  the  largest  category  will  probably 
be  the  low  IQ  group— those  irtio  can't  read  because  of  lack  of 
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normal  Intelligence.  (!niese  examinees  will  probably  get  low 
scores  on  all  the  tests,  not  J\ist  the  ones  mentioned  above  as 
being  directly  dependent  on  reading  ability 0 

(2)  A  second  and  much  smaller  category  will 
consist  of  those  \diose  chief  difficulty  has  been  in  learning 
to  read  and  ^o  appear  to  have  normal  intelligence  in  other 
respects.  Such  examinees,  theoretically,  mlg^t  score  quite 
well  on  some  of  the  less  verbal  tests  in  the  battery>-e.g.. 
Object. Inspection,  Visualization  in  Two  dimensions.  Visual¬ 
ization  in  Three  dmeasiOnsv  Abstract  Reasoning. 

(3)  Ihere  may  also  be  some  foreign  students 
who  haven't  learned  enou^  English  yet  to  be  able  to  cope 
with  the  verbal  tests.  (Ihese  students  should  be  identifiable 
from  the  Stxident  Information  Blank  and  other  auxiliary  sources 
of  information.) 

(4)  Some  Instances  of  reading  disability  may 
stem  from  the  fact  that  the  student  heuB  been  deprived  of  a 
normal  education— ^■by  illness  or  physical  disability,  for 
Instance,  (ihese  students,  too,  may  be  identifiable  from 
the  Student  Information  Blank  euid  other  auxiliary  sources  of 
information.) 

b.  Others,  whose  low  scores  are  primarily  reflections 
of  poor  motivation  in  the  test -taking  situation 

(1)  A  few  nay  make  numerous  clerical  errors 
(accidentally  marking  answer  spaces  other  than  those  corres* 
ponding  to  the  intended  answer) .  These  students  should  be 
characterized  by  a  very  low  score  on  the  derlcal  Cheeking 
Test  and  the  Table  Reading  Test,  lAilch  are  meastures  of  clerical 
speed  and  accuracy. 

(2)  Ihose  idiose  genered  attitude  is  apathetic 
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or  Indifferent  can  be  expected  to  have  many  low  scores  In 
the  less  verbal  tests  as  well  as  In  those  req.ulrlng  good  :  ■ 
reading  ability. 

(3)  ISiose  whose  attltiide  Is  flippant  can  be 
expected  to  have  a  peculiar  pattern  of  item  responses— for 
Instance  a  pattern  vhich.  yields  a  score  much  lower  .than  a 
pattern  of  purely  chance  responses  would  be  expected  to  give. 

(h)  Hiere  may  be  some  whose  attitude  is 
flippant  only  in  regard  to  certain  kinds  of  items.  For 
instance^  the  extreme  easiness  of  the  Screening  items  may  in 
itself  induce  in  some  students  a  flippant  attitude  towards 
these  items— manifested  by  the  deliberate  choice  of  wrong 
answers.  Such  behavior  can  be  spotted  by  the  fact  that  the 
Screening  score  would  be  much  lover  than  would  be  reasonable 
in  view  of  the  pattern  of  the  other  Information  scores. 

There  is  no  expectation  ^diatever.  that  it  will  be  possible 
on  the  basis  of  the  Screening  score  alone  to  differentiate 
among  the  several  categories  of  "non-readers"  and  badly 
motivated  students  mentioned  above.  But  the  Screening  score 
will  differentiate  those  ^0  fall  in  any  of  these  categories 
from  students  ^o  have  normal  reading  ability  and  are  moti¬ 
vated  to  do  well.  .And  the  pattern  of  other  test  scores,  as 
s\iggested  above,  may  help  to  differentiate  among;  the  varlovis 
categories.  ,A  low  Screening  score  will  indicate  that  in  the 
absence  of  evidence  to  the  contrary  (e.g.,  low  scores  on  all 
tests — even  those  not  requiring  reading),  scores  on  Arith¬ 
metic  Reasoning,  Mechanical  Reasoning,  Creativity,  the  rest 
of  the  Information  scales,  etc.,  and  the  responses  on  the 
various  inventories  may  be  quite  misleading.  In  other  words, 


it  is  conceivable,  though  not  necessarily  actmlly  true,  that 
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the  examinee's  scores  on  these  tests  ml^t  be  much  hlc^er  If 
someone  were  reading  the  test  Items  to  him,  and  recording 
his  responses  for  him. 

To  serve  these  puxposes  the  items  are  extremely  aiiig)le, 
involving  concepts  that  edmost  everybody  above  the  level  of  a 
low-grade  moron  would  be  familiar  with. 

The  vocabtilary  has  been  kept  as  slaqple  as  .  is  reasonable 
(as  is  also  the  case  for  the  tests  whose  scores  may  be  in¬ 
ferred  to  be  invalid  for  those  with  low  Screening  scores . 

.In  the  case  of  these  latter  tests,  it  may  be  remarked  paren¬ 
thetically  that  the  vocabulary  should  be  very  simple  except 
^diere  more  difficult  words  are  necessary  in  order  to  test 
idiether  the  student  con^rehends  a  certain  concept.) 

nie  Screening  items  have  been  arranged  in  the  Information 
Test  in  such  a  yny  they  occur  very  frequently  at  the  be¬ 
ginning  of  the  test,  then  less  cusd  less  frequently  so  that 
the  Intezvals  between  successive  Screening  Items  increase  in 
accordance  with  a  rou^  geometi^io  progression,  and  then 
finally  a  few  items  are  concentrated  at  the  end.  Ihe  purpose 
of  this  arrangement  is  to  keep  the  students  that  eure  having 
difficulty  with  the  test  aware  that  very  easy  items  occur 
sporadically.  Ihe  aim  is  to  encourage  these  students  to 
read  every  item. 

IQie  following  is  a  saatple  Screening  item: 

Item  36.  HOw  many  days  are  there  in  a  week? 

A.  .2 

B.  3 

C.  5 

D.  T 

E.  10 


(ihe  answer  is  7*) 


Scientific  Attitude  Scale 


Hiese  items  provide  a  subscore  >dxlch  should  be  indicative 

of  hov  the  IndlvlduEd  views  the  world— \diether^  on  the  one 

/ 

hand,  he  views  it  as  a  place  where  there  are  logical  cause- 
and-effect  relationships  or  whether,  on  the  other  hand,  he  . 
regards  it  as  a  place  idiere  consequences  are  illogical, 
capricious,  and  arbitraiy.  In  the  latter  category  (illogical 
and  arbitrary  consequences)  fail  the  modern-day  equivalents 
of  the  kinds  of  primitive  beliefs  that  Frazer*,  in  his 


*Pra2er,  J.  G.,  The  Golden  Bough.  New  York,  Macmillan,  1922. 


epochal  treatise  on  criltural  anthropology.  The  Golden 
Bovmfa.'  terms  "sympathetic  magic".  Also  in  the  category  of 
iUoglceQ.  and  arbitiary  consequences  are  the  premises  of 
palmistry,  astrology,  numerology,  and  occult  manifestations 
of  all  sorts.  Among  the  students  who  should  get  low  scores 
on  this  scale  are: 

a.  Those  who  are  superstitious,  in  the  sense  that  they 
believe  such  things  as  that  black  cats  bring  bad  luck,  horse¬ 
shoes  bring  good  luck,  Friday  the  13th  meeuis  trouble,  there 
is  something  in  astrology  (at  least  when  the  astrologer  is 

an  expert),  etc. 

b.  Those  who  believe  that  certain  people — e.g.,  gypsies, 
mediums,  etc.— have  occult  powers  of  one  sort  or  another— 
for  instance  that  they  can  see  into  the  future  or  converse 
with  the  dead. 

c.  Close  who  favor  anthropomorphic  eiqplanatlons  of  the 
behavior  of  lower  animeils. 

d.  ;  Close  irtio  believe  that  the  world  is  full  of  evil 
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spirits  that  have  to  be  propitiated. 

e.  !I?hose  \dio  do  not  seek  a  loglca!^  ejcplanatlon  for 
unejqplalned  phenomena,  hut  Instead  tend  to  accept  naively 
the  first  explanation  presented  that  is  superficially 
attractive . 

Among  the  people  vho  should  get  high  scores  are  those 
mAxo,  like  the  scientist,  seek  reasonable  and  logical  ex¬ 
planations  for  events  and  une:q)lalned  i^enomena,  and  tend 
to  reject  explanations  that  Involve  occtilt  sorts,  magic, 
etc .  It  aho^d  be  noted  that  a  person  nay  have  a  scientific 
attitude  even  if  he  has  never  studied  science  formally  and 
has  little  or  no  factual  information  about  hov  scientific 
research  is  actusdly  carried  out.  It  will  be  seen  that  the 
trait  to  be  differentiated  by  these  scores  involves  not  only 
intellectiial  ability  (the  Judgment  and  reasoning  power 
necessary  to  decide  whether  a  "conclusion"  follows  logically 
from  given  premises)  but  also  a  basic  tendency  to  use  the 
scientific  approach. 

■  Each  item  consists  of  a  description  of  a  phenomenon  or 
8U1  occiirrence.  Five  explanations  sure  presented,  and  the 
task  is  to  select  the  "best"  one.  Only  one  of  the  five 
explanations  is  reasonable  and  logical.  Of  the  other  four, 
some  involve  common  superstitions,  magic,  concepts  incom¬ 
patible  with  the  scientific  viewpoint,  belief  in  the  occult, 
etc .  Selection  of  other  dlstractors,  however,  may  prlaarlly 
iiq^  muddled  thinking  on  the  part  of  the  examinee.  (An 
exarngple  of  the  latter  kind  of  dlstractor  would  be  Option  C 
in  Saagile  Item  37,  below.)  One  reason  for  including  such 
options  is  that  it  is  probably  undesirable  to  have  all  dls¬ 
tractors  fall  in  the  other  category  (superstition,  the 
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occult^  etc.)  since  this  makes  the  Items  too  obvious. 

None  of  the  Items  req.ulres  possession  of  any  special 
inforaation  (in  sclence>  mathematics,  etc.).  Whenever 
such  Infozmatlon  is  needed  to  answer  the  q.uestlon,  It  Is 
presented  In  the  stem  of  the  Item.  For  Instance,  In  Sanqple 
Item  38  below,  the  probability  that  ten  coins  will  fall 
"heads  up"  Is  stated.  In  TOund  numbers.  In  the  Item. 

Item  37.  Jim  Wilson  has  entered  many  golf  tourna¬ 
ments  but  has  never  won  one.  He  usually 
does  very  well  until  the  finals.  But  In 
the  finals  ^en  the  score  Is  close,  he 
tends  to  make  a  few  wild  shots,  which  re¬ 
sult  In  his  defeat.  The  best  explanation 
of  Wilson's  failure  to  win  a  tournament 
Is  that 

A.  he  is  Just  naturally  unlucky. 

B.  he  "goes  to  pieces"  under  pressure. 

C.  he  hasn't  practiced, 

D.  he  doesn't  really  ceire  \diether  he  wins, 

E.  his  opponents  are  Just  naturally  lucky. 

(The  answer  is  B.) 

Item  38.  Professor  Rogers  wished  to  find  out 

Aether  emy  of  the  950  students  In  Centrsil 
High  School  could  demonstrate  the  power 
of  "mind  over  matter".  When  ten  pennies 
ewe  tossed,  the  chances  that  all  ten  of 
them  will  fall  "heeuls  up"  are  about  one  In 
a  thousand.  Rogers  heui  each  student  In 
turn  toss  ten  pennies.  He  instructed  them 
to  try,  by  thinking  very  hard  about  it,  to 
sake  all  ten  pennies  fall  "heads  up".  But 
when  one  of  the  boys,  Joe  Thompcon,  tossed 
the  coins  they  all  fell  "tails  up".  What 
does  this  suggest  about  Joe? 

A.  Joe  was  purposely  trying  to  get  all  tails. 

B.  Joe  became  confused. 

C.  Joe  didn’t  have  faith  in  the  power  of  mind 
over  matter. 

D.  Joe  is  unlucky. 

E.  Nothing. 

(I3ie  answer  is  E.) 

It  is  hypothesized  that  scores  on  this  test  are  related  to 
science  aptitude. 
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Mechanic^  Information  Scale* 

Purpose  of  scale.  Mechanical  Information  Scales  are 
visually  Intended  to  provide  a  measure  of  aptitude  for  Jobs 
In  the  mechanical  area.  The  underlying  .as8vaQ)tlon  Is  that 
anyone  \dio  has  aptitude  In  this  area  8Lnd  .eG.80  hais  sufficient 
Interest  In  It  that  he  would  enjoy  this  type  of  activity 
would  manage  In  one  way  or  another  to  eicqulre  considerable 
Information  In  the  area.  It  Is  assumed. that  he  would  be 
likely  to  acquire  this  Infonnatlon  idiether.  or  not  the  hl^ 
school  he  attended  happened  to  offer  formal  Instruction  In  ' 
mechanical  subjects. 

Historical  antecedents.  Among  the  first  standardized 
tests  of  mechanical  Information  were  the  eevrly  trade  tests 
developed  for  use  In  the  Army  during  World  Whr  I.  These 
were  specific  . Information  tests  developed  for  various  sorts 
of  mechanical  occupations,  and  their  purpose  was  to  measure 
the  achievement  of  Individuals  in  those  fields.  The  items 
were  of  types  much  like  those  In  current  use.  Hie  Army  Alpha 
too  had  a  few  Information  Items  on  mechanical  topics .  In  the 
early  tests  of  mechanical  Information,  unlike  the  more  recent 
ones,  no  distinction  was  made  between  mechanlceil  information 
(tools,  materials,  mecheinlcs,  carpentry,  cabinet  making, 
painting,  printing,  surveying,  etc.)  and  electrical  Informa¬ 
tion.  In  current  practice  electrical  euid  electronic  Informa¬ 
tion  are  often  covered  In  a  sepeirate  test  since  Individuals 


*As  has  already  been  Indicated,  these  Itmss  are  embedded  in 
the  Information  Test. 


who  do  well  In  mechanical  information  tests  are  not  necessarily 
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veil  informed  In  the  areas  of  electricity  and  electronics^ 
and  vice  versa.  Contesqporary  tests  of  mechanical  informa¬ 
tion  have  proved  useful  for  predicting  siuscess  in  many 
types  of  Jobs 4  including  aircraft  mechanic,  auto  mechanic, 
radio  repsLlrman, .  radar  repairman,  machlhiat,  sheet  metal 
vorker,  velder,  etc.  In  World  Wlar  II,  the  Army,  Navy,  and 
Air  Force  all  made  extensive  use  of  mechanical  information 
tests  with  considerable  success. 

In  part,  mechanical,  information  tests  measure  res4ing 
ability:  and  general  leeumlng  ability  (the  ability  to 
assimilate  information  vhcn  exposed  to  it);  in  other  words, 
abstract  Intelligence.  However,  in  a  well  designed  mechan¬ 
ical  i  information  test  the  demands  on  reading  skills  are 
minimal  even  if  verbal  rather  than  pictorial  items  are  used. 
An  effort  is  made  to  keep  the  wording  of  the  items  simple. 

Pronounced  sex  differences  are  usually  found  in  scores 
on  mechanical  information  tests;  these  differences,  however, 
are  often  less  pronounced  when  the  items  are  of  the  verbal 
type  than  when  they  are  pictorial. 

In  sximmary,  mechanical  information  tests  chiefly  provide 
measures  of  what  has  sometimes  been  called  the  "mechanical 
experience  factor". 

Description  of  Talent  Mechanical  Information  Scale.  The 
items  in  this  scale  are  all  of  the  verbal  type,  not  the 
pictorial  type.  Each  of  the  items  falls  into  one  of  the 
following  two  categories: 

1.  Information  about  tools,  earp«itry,  and  other  klnda 
of  construction 

2.  Information  about  motors  euid,  other  kinds  of 
mechanisms 
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The  items  are  about  eq.ually  divided  between  the  two 
categories.  As  it  happens,  however,  this  is  not  a  partlc> 
ularly  In^rtant  distinction  (eiccept  as  a  way  of  insuring 
bresidth  of  coverage),  since  those  idxo  do  well  in  one  of  the 
two  categories  tend  to  do  well  in  both;  in  other  words, 
scores  on  the  two  sets  of  items  axe  quite  highly  correlated. 
For  this  reason  the  two  categories  of  items  have  been  com¬ 
bined  in  a  single  scale. 

Ihe  test  taps  a  wide  range  of  mechanical  information. 
Many  of  the  items  call  for  information  about  automobiles; 
other  items  are  concerned  with  other  common  machines  auad 
tools  with  which  boys  viio  are  Interested  in  mechanical 
activities  are  likely  to  be  familiar.  Ihe  enqphasls  is  on 
information  acquired  through  direct  e:q>erlence  with  tools 
and  motors.  The  very  wide  vsirlety  of  information  covered 
tends  to  equalize  the  opportunities  of  boys  in  itrbstn  and 
rursLl  environments  to  score  well  cuid  helps  msJce  the  scores 
conqmrable. 

A  sa]iq>le  item  follows: 

Item  39.  Which  of  these  tools  is  best  for  rough- 
shaping  wood? 

A.  .  Basp 

B.  Plane 

C.  Level 

D.  Awl 

E.  File  , 

(The  answer  is  A.) 

Having  briefly  described  the  kinds  of  items  the 
Mechanical  Information  scale  Includes,  perhaps  it  would  be 
well  to  say  a  word  or  two  about  idiat  it  does  not  Include. 
Items  to  measure  Information  that  would  be  aicqulred  in  an 
academic  covirse  in  science  (e.g. ,  a  course  in  physics)  are 
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Included  in  the  Physical  Science  Information  scale  rather 
than  in  the  Mechanical  Information  scale  except  In  the  case 
of  Items  idilch  primarily  stress  a  practload  application 
relevant  to  ..j  mechanics.  Neither  scale  has  items  requiring 
comprehension  of  mechanical  principles  and  everyday  physical 
forces  (e.g,j  gravity,  egulllbrlum,  pressure,  etc.).  'Such 
items  are  In  another  Talent  test>-the  Mechanical  Reasoning 
Test.  Nor  are  items  requiring  a  comprehension  of  electricity 
lncl\ided  in  the  Mechanical  Information  scale  even  if  they 
are  concerned  vlth  motors.  Such  Items  eire  in  the  Electricity 
and  Electronics  scale. 

In  interpreting  scores  on  this  test,  peist  mechanical 
experience  or  formal  training  in  mechanics  should  of  course 
be  considered.  Certainly,  too,  the  sex  of  the  individual  r; 
shoTild  be  borne  in  mind  in  interpreting,  a  score .  . In  general 
those  ^o  score  well  in  Mechanical  Information  will  tend  to 
do  well  in  training  for  a  wide  variety  of  mechanical  occu¬ 
pations;  for  instance,  machinist,  artillery  mechanic,  sheet 
metal  worker,  foundryman,  aircraft  mechanic,  auto  mechanic. 
Gunner's  Mate,  and  aircraft  pilot. 

Electrical  and  Electronic  Information  Scale* 

Purpose  of  scale.  This  scale  is  intended  to  serve  as  a 
predictor  of  success  in  Jobs  in  the  area  of  electricity  smd 


*^A8  has  already  been  indicated,  these  items  are  embedded  in 
the  Information  Test. 


electronics  (e.g.,  electriclaui,  electzonlc  technician,  radio 
and  television  repairman) . 
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Historical  ^iteeedentB.  ^Diere  is  nothing  particularly 
novel  about  using  electrical  and  electronic  Infonnatlon  tests 
.  vlth  content  geared  to  a  specific  training  course  as  straight¬ 
forward  measures  of  achievement  in  the  training  program.  But 
extensive  use  of ;  electrlcail  and  electronic  information  tests 
with  more  general  content  as  predictors  of  success  in  rele¬ 
vant  kinds  of  Jobs  does  not  seem  to  date  back  any  further 
than  World  Whr  II. 

.  At  that  time,  the  military.  ser\rlces  found  that  tests  of 
electrical  and  electronic  Information  were  useful  in  iden¬ 
tifying  persons  ^o  would  make  good  electricians  or  electronic 
technicians  (though  not  necessarily  good  mechanics).  Ihis 
sort  of  test  was  therefore  used  extensively  8uid  successfully 
in  assigning  military  personnel  to  specific  training  programs. 
Ever  since  then  it  has  been  realized  that  the  occupatioxial 
fields  represented  by  mechanical  Jobs  and  electrical  Jobs 
are  functionally  different.  Civilian  versions  of  electrical 
and  electronic  information  tests  for  use  in  selection  and 
counseling  were  not  developed  until  quite  recently  (  ) . 

Electronic  information  tests  have  proved  useful  to  pre¬ 
dict  success  in  numerous  Jobs,  Including  electrician, 
electronic  technicisin,  radio  repairman,  radar  repairman. 

A  word  of  caution  may  be  advisable  at  this  point.  When 
tests  are  being  lused  for  seiactidn  it  is  perhaps  even  truer 
in  the  case  of  Jobs  in  the  electricea  suad  electronics  field 
than  in  other  fields  that  decisions  should  not  be  bued  on 
Just  one  test.  The  entire  pattern  of  scores  on  several 
other  aptitude  and  achievement  tests  is  atlso  highly  relevant 
in  the  case  of  most  such  Jobs.  ^ 


Description  of  Talent  Bleetrlclty  and  ELectronlcs  Scale. 
Most  of  the  Items  in  this  scale  are  of  the  verbal  '^rpe, 
thouj^  a  few  do  involve  diagrams*  13ie  items  stress  infor¬ 
mation  that  is  acquirable  throu^^  direct  es^rlence  in  the 
construction  and  malntensuice  of  electrics^  and  electronic; 
equipment.  Thus^  for  instance^  examinees  who  have  worked  ci 
on  radios^  hi-fi  sets>  or  other  electronloceqUipBent  would 
have  an  adyantsige.  It  is  Inevitable  that  some  of  the  items 
will  also  be  answerable  on  the  basis  of  Infoxination  acquired 
in  fozmml  courses  in  physics  and  to  a  lesser  extent  in 
chemistry.  However,  items  that  can  be  answered  on  this 
beisls  even  by  persons  >dxo  have'  not  had  much  direct  exper¬ 
ience  in  con8trud|ilng  or  maintaining  electrical  or  electronic 
equipment  should  be  kept  to  a  minimum. 

Scores  on  the  Electricity  and  Elecr1|^rQhiC8  scale  tindeni- 
ably  are  considerably  affected  by  past  experience  in  the 
area,  but  since  a  broad  range  of  content  Is  covered,  the 
average  high  school  student  will  probably  have  bad. an 
opportunity  to  eusqulre  a  fair  amount  of  the  information 
tested  if  he  Is  at  eQJ.  Interested  in  this  area  and  has  any 
aptitude  for  it.  In  other  words,  those  who  get  good  scores 
on  this  scale  eoe  likely  to  have  both  interest  in  the  field 
and  aptitude  for  it  (as  indicated  by  the  demonstrated 
ability  to  Mslmllate  this  type  of  information).  Biey  could 
probably  successfully  con^lete  any  training  course  in  the 
surea.  A  low  score  on  the  scale  does  not  indicate  that  a 
youngster  lacks  the  ability  to  learn  this  kind  of  material 
if  he  is  exposed  to  it.  However,  if  he  has  not  been  exposed 
to  this  area  by  age  l6  or  l8  and  has  no  knowledge  of  it,  the 
prognosis  for  success  In  an  electronics  or  electrical 
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training  program  would  be  substantially  lowered. 

■Aeronautics  and  Bpace  Scale* 

Purpose  of  scale.  Ibis  scale  is  intended  to  help 
identify  students  idiose  interests  and  aptitudes  suggest 
that  they  wovild  be  successful  pilots. 

.Historical  antecedents.  .As  has  already  been  indicated, 
among  the  discoveries  made  by  the  Aviation  Psychology  Re¬ 
search  Program  during  .Kbrld  Vfar  11  was  the  fact  that  one  of 
the  tests  that  made  an  lagortant  cOni^ibutlon  to  the  pre¬ 
diction  of  success  in  a  pilot  training  program  was  an  in- 
foxmation  test  heavily  loaded  with  qiiestlons  about  aero¬ 
nautics  and  related  topics. 


*As  has  already  been  indicated,  these  items  are  embedded  in 
the  Inforoation  Test. 


Description  of  thlent  Aeronautics  and  Space  Shale.  .The 
items  are  on  such  topics  as  piloting  procedures,  navigation. 
Jet  planes,  space  exploration,  etc. 

P*  Ifaidaar  f or  Slntences  Teat 
Purpose  of  test.  The  pvupose  of  the  test  is  to  measxire 
one  hind  of  memory — the  ability  to  memorise  and  recall 
meaningful  material. 

Historical  antecedents ♦  This  test  is  e:Qerlmental  in 
nature.  Runerous  tests  of  ability  to  memorise  materials 
have  been  developed  in  the  past,  but  m  far  as  the  auth.ors 
of  this  booh  know,  the  tg^pe  of  item  used  in  the  Talmit 
Memory  for  Sentences  Test  has  not  been  used  before  in  pre¬ 
cisely  the  same  form.  .Tbls  item  type  is  a  multiple -choice 
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version  of  a  kind  of  cosqpletlon  test  that  heul  been  developed 
to  measure  essentially  the  same  thing. 

This  earlier  best  consists  of  a  study  period  In  vhlch  a 
hvoaber  of  sentences  are  to  be  memorized,  followed  by  a  testing 
period  In  which  some  or  all  of  the  sane  sentences  are  presented 
In  a  different  order,  with  one  word  missing  from  each.  The 
task  Is  to  fill  in  the  missing  word. 

Description  of  Talent  Memory  for  Sentences  Test.  This 
test  consists  of  about  1*0  short  sentences,  which  the  students 
axe  given  six  minutes  to  memorize.  Ihe  test  Items  consist 
of  some  of  these  sentences,  in  a  different  order,  with  one 
word  omitted  from  each  sentence.  The  task,  which  the  ex¬ 
aminees  are  told  about  at  the  time  they  are  asked  to  study 
the  sentences,  is  to  recall  the  missing  word  and  identify 

its  second  letter,  which  is  one  of  five  options.  Each  option 

» 

consists  of  only  one  letter,  instead  Of  an  entire  word,  so 
as  to  test  the  ability  to  actually  recall  the  missing  word, 
rather  than  merely  the  ability  to  recognize  the  word  when 
it  is  presented.  The  second  letter  is  used  instead  of  the 
first  In  order  to  minimize  the  extent  to  vdiich  the  letter 
Itself  will  help  the  person  to  recall  the  missing  word  if 
he  has  forgotten  it. 

There  are  several  different  dimensions  in  terms  of 
which  memory  tasks  can  be  classified: 

1.  Recall  vs.  recognition 

2.  Short-term  memory  vs.  long-tenn  manory 

3.  Incidental  monory  vs.  deliberate  monorizing 

4.  Memory  for  "underleamed”  materials  vs.  loemory  for 
”overlearned"  materials 

5.  Kind  of  material  to  be  remembered  (e.g.,  verbal 
material,  diagrams  or  pictxires,  music) 
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6.  .Meaningfulness  of  materials  to  be  remembered  (e.g., 

meanlagtul  material  such  as  paragraphs  vs.  meaning¬ 
less  material  such  as  nonsense  syllables).  i 

7.  When  the  material  to  be  learned  Is  meaningful^ 

idiat  Is  the  nature  of  the  leamlag  task?  Must  the  * 

material  (e.g.,  sentences)  be  memorized  verbatim  or 

Is  It  s\ifflclent  merely  to  remember  the  sense  and  be 

able  to  paraphrase  It?  ^ 

Where  does  the  Talent  Memory  for  Sentences  Test  stand 
In  respect  to  these  seven  dimensions? 

In  the  first  place  we  believe  It  measures  recall  rather 
than  recognition.  That  point  has  alreeuSy  been  discussed 
but  perhaps  It  shotild  be  underlined  for  the  benefit  of  those 
critics  of  objective  tests  who  say  that  It  Is  Impossible  to 
measure  recall  with  an  objective  test — that  all  that  can  be 
done  Is  to  measure  recognition.  The  authors  disagree,  euid 
offer  the  Memory  for  Sentences  Test  as  evidence. 

j 

In  regard  to  the  short-term  long-term  dimension,  the 
test  measures  relatively  short-term  memory.  However,  be¬ 
cause  two  other  tests  (Arithmetic  Conqputatlon  and  Memory 
for  Words)  Intervene  between  the  study  period  and  the  test 
period  of  the  Memory  for  Sentences  Test,  the  Interval  be¬ 
tween  study  and  test  Is  .sufficiently  long  (about  20  minutes) 
that  something  more  than  immediate  memory  Is  tested.  Further¬ 
more,  the  task  Is  made  considerably  more  difficult  by  the 
retroswtlve  Inhibition  (if  we  may  lapse  Into  psychologist 
Jargon  for  a  moment)  set  up  by  the  Intervening  memory  task 
(monory  for  words). 

Memory  for  materials  which  the  student  deliberately 
tries  to  memorize  is  measured— not  liusldental  memory. 

^femory  for  materials  idilch  are  probably  underleamed  Is  , 

meastired — not  memory  for  overleamed  materials. 

The  material  to  be  memorized  is  verbal  (l.e.,  sentences). 


The  material  is  modtrat#ly  but  peziiaps  not  maximally 
meaningful.  It  is  modHratdy  meaningful  becsttse  lt  bonsti^s 
of  meaningful'  sentences*  but  tbsty  mcmU  be  auoli  more  moaning* 
ful  if  they  sere  not  isolated  sonteiwes,  completely  removed 
from  context. 

The  task  is  such  that  verbatim  memorization  is  required. 
Synonyms  for  the  missing  vords  are  not  acceptable,  (in 
this  connection  it  should  be  noted  'Ouit  items  sere  Hot  used 
idxere  an  obivous  synonym  of  the  Bdssing  word  would  have  'the 
same  second  letter.) 

In  the  preceding  paragraphs  we  have  gone  into  consider¬ 
able  detail  concerning  what  kind  of  memory  is  measured  by 
'this  test  because  it  is  so  easy  (and  so  risky)  for  test 
users  to  overgeneralize  from  the  title  of  a  test  .nd  to 
infer,  for  instance,  that  because  a  test  has  the  word 
"memory"  in  its  title  it  will  Indicate  how  well  someone 
can  do  In  all  kinds  of  memory  tasks.  Nothing  could  be 
further  from  the  truth.  There  are  many  specific  kinds  of 

memory,  and  if  results  derived  from  a  test  of  one  kind  of 

1 

memory  are  generalized  to  other  kinds  it  should  be  done  only 
with  extreme  caution.  Interpretation  of  results  ehovU.d  be 
based  Insofar  as  possible  on  empirical  data— for  Instance, 

I 

specific  studies  of  what  kinds  of  variables  the  score  on 
the  test  correla-te  with. 

Having  stressed  that  warning,  perhaps  It  is  safe  at  this 
point  to  mention  that  it  is  usually  considered  reasonable  to 
regard  the  kind  of  memory  measured  by  this  ^st  as  one 
aspect  of  the  complex  of  abilities  subsumed  under  the  tern 
"general  Intelligence" .  Those  who  do  well  on  the  test  are 
probably  likely  to  do  well  in  types  of  school  work  that  call 
for  rote  learning  of  verbal  materials. 
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■ad  tlMgr  vUl  also  probidtly  Mks  good  laitd*L  vrpfrott  la 
trolnlzig  pragTMu  vhftro  *  lot  of  ■OMoelatuM  aad  opoelflc 
faett  are  to  be  learned* 

fo  give  an  Idee  of  the  ehareeter  of  the  ahatenee  to  be  een- 
orised  aad  the  items  to  be  aaswered^  a  s^le  cut  each  Is  given. 

The  foUovitig  seatenee  night  have  beea  (bat  vasa^t)  used. 

.  as  one  of  the  l«-0  to  be  memorized:  _ 

"Mary  tried  to  catch  the  four  o'clock  bus." 

If  that  sentence  had  been  used,  the  following  couM 
have  been  one  of  the  test  items: 

Item  ^0.  Mary  to  catch  the  four  o'clock  bus^ 

A.  __a  _  Ri  _r  _____ 

E .  ~e  _  U»  ju 

Iv  ~i  _  (The  wsver  is  R»*«the  second 

letter  of  '’trled''c) 

A  systematic  effort  was  made  to  Insure  that  If  a  person 

knew  the  answer  to  an  item  he  knew  It  because  he  had  succeeded 

in  meakcrlzlng  the  sents-ocej  a^  not  fcr  any  other  reason.  For 

this  r5i(3<*n  rf;?:  iVur  Jetters  that  were  used  as  dlstractors  were 

always  the  se:criCl  letters  of  words  that  night  reasonably  fill 

the  blank  space  in  the  sentence-  instance  in  the  case  of 

the  sample  itr-'r  9tove.  the  missing  word  could  conceivably  be: 

ran,  wanted/  bad,  failed  (second  letter:  a) 
needed,  decided,  went  (second  letter:  e) 
liked*  wished  (second  letter:  l) 
hurried,  rushed,  (second  letter;  u) ' 

TO  avoid  confusion,  the  flrat  letter  of  tdie  missl*'.:^  vcu'd 
was  never  used  aa  m  distrmetor.  lote,  for  lastance,  that  in 
.  the  sin^ls  Itsm  shove,  T  (thm  first  hettsor  of  "trirnd”)  sea  not 
used  even  though  it  sma  also  the  sseond  Imtter  of  m  plausibls, 
though  incorrect  word  (''atte^>ted" 

UK.f.vl6e  in  •*.^3  to  Insure  that  if  somecne 

answered  an  item  in:orrectl.v  it  vas  because  be  did  not 
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remember  the  sentence — not  beca\ue  of  faiilty  spelling. 
Therefore,  no  item  was  vised  ^ere  the  missing  word  was  a 
hard  one  to  spell,  and  for  which,  therefore,  there  mlg^t  be 
some  confusion  or  misconception  in  the  mind  of  the  examinee 
as  to  ^at  the  second  letter  is.  For  Instance  the  following 
Item  would  be  a  bad  one: 

"Dr.  Phwliiq;hBniggitch  is  a  professor  of  psychology," 
If  "psychology"  were  the  missing  word  in  this  sentence,  and 
If  the  options  were  E,  H,  I,  S,  and  Y,  an  examinee  might 
choOae  Option  H  under  the  very  prevalent  misconception  that 
"psychology"  is  spelled  "phyohology";  other  ways  of  mis¬ 
spelling  could  easily  yield  I  and  Y  as  answers . 

C.  Memory  for  Words  Test 

Purpose  of  test.  Kie  purpose  of  this  test  is  to  measure 
one  kind  of  rote  memory— the  ability  to  memorize  the  "foreign'* 
words  corresponding  to  common  English  words.  OSils  is  an 
ability  which  is  obviously  directly  relevant  to  the  learning 
of  a  fqrelgn  language.  It  is  also  presumably  related  to 
the  ability  to  learn  skmy  other  kinds  of  material . 

Historical  antecedents.  Various  kinds  of  "paired 
associates"  tests  have  been  used  for.  a  long  time  in 
psychological  research  bn  the  nature  of  memory,  and  also 
as  congionents  of  intelligence  tests  and  predictors  of 
success  in  occupations  ^ere  this  kind  of  memory  seems 
relevant.  A  "paired  associates"  test  is, a  test^ln^idilch  a 
set  of  pairs  of  symbols  is  studied  for  a  fixed  period,  to 
associate  each  symbol  with  the  one  paired  wllh  it.  Ihe 
synbols  used  may  be  of  any  nature  (real  words,  nonsense 
syllables,  numbers,  diagrams,  pictvires,  persons'  names,  etc.) 


As  early  as  Vbrld  Uar  I,  paired  assoclatea  were  used 
to  measure  code  learning  ability.  More  recently,  Carroll 
and  8apon  (  3 )  developed  a  "Faired  Associates”  Test  (Test  5 
In  the  Psl -Lambda  Foreign  Lemguage  Aptitude  Battery)  for 
\uie  In  predicting  ability  to  learn  foreign  languages.  This 
test  has  been  shown  to  be  useful  for  Its  intended  purpose. 
Using  a  feictor  analysis  technique'**^  Carroll  (  2  )  found,  for 


'’^Factor  analysis  Is  a  statistical  procedure  for  analyzing 
the  Interrelationships  among  a  set  of  variables. 


Instance,  that  his  "Paired.  Associates”  Test  measured  a 
factor  he  designated,  as  "sissoclatlve  memory”  suid  to  a 
somewhat  lesser  extent  a  faustor  he  called  "linguistic  In¬ 
terest”,  both  of  which  were  related  to  course  grades  In  an 
Intensive  Air  Force  "trial  course"  In  Mandarin  Chinese. 

Description  of  Talent  Memory  for  Words  Test.  This 
test  Is  modeled  directly  on  Test  5  (Paired  Associates)  of 
the  Psl-Lanibda  Foreign  Language  Aptitude  Battery, 

In  this  test  the  strident  Is  given  two  minutes  to 
study  2k  common  English  words,  and  their  alleged  equivalents 
In  a  strange  and  totsilly  unfamiliar  language.  To  Insure 
that  the  language  would  be  unfamlllaur  to  all,  a  language 
named  Vlaznoor,  Invented  specially  for  use  In  the  TEuLent 
test,  was  used.  The  two-mlnute  study  period  is  followed 
^  a  two-mlnute  practice  period  In  idilch  the  studoits 
practice  recall,  using  a  list  of  the  Vlaznoor  words  arranged 
In  a  different  order.  .Ability  to  select  the  English  equiv¬ 
alent  of  a  given  foreign  (Vlaznoor)  word  from  among  five 
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options  is  then  tested.  Each  Vlaznoor  wovd  Is  a  separate 
lt«B.,  and  they  are  In  a  different  order  from  those  used  In 
the  learalng  ;and  practice  materials.  Almost  all  options 
are  English  words  vtsed  In  the  vocabulary  studied,  althou^ 
an  occasional  English  word  not  In  the  vocabulary  studied 
may  be  used  as  a  dlstractor— e.g.,  "In",  \dien  "on"  Is  the 
rl£hb  answer. 

The  foreign  words  are  grossly  different  from  each 
other.  Words  that  differ  In  only  one  letter  (e.g.,,  ERINVO 
and  QRANVO)  are  not  used.  Each  of  the  foreign  words  Is  a 
pronounceable  combination  of  vowels  and  consonants  (e.g., 
KAJELB),  not  an  unpronounceable  Jumble  consisting  solely  of 
consonants  (e.g,,  BTFlfiFKT) .  !Ihe  foreign  words  are  mostly 
monosyllables,  or  at  most  dlsyllables. 

A  san5)le  of  the  type  of  vocabulary  used  Is  shown 
below: 


Foreign 

English 

KAJELB 

walk 

miMVO 

potato 

HOL 

t 

ear 

» 

t 

TAHNE 

t 

1 

pretty 

1 

t 

FALG 

1 

shoe 

The  following  Is  a  san^le  test  Item: 

Item  41.  DRINVO 

A.  ecu: 

B.  pretty 

C.  shoe 

D.  potato 

E.  walk 

(ihe  answer  Is  O.) 

Ihls  test  meeisures  ability  to  memorize  pairs  of 
arbitrarily  associated  expressions,  when  one  member  of  the 
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pair  Is  a  meaningful  English  vord,  and  the  other  Is  a  mean¬ 
ingless  verbea  symbol. 

IQils  test  differs  from  the  other  memorization  test  In 
the  battery^  the  Memory  for  Sentences  Test^  In  several  major 
reapects  besides  the  very  obvious  one  of  the  nature  of  the 
materl8J.s  to  be  memorized. 

Ihe  Memory  for  Words  Test,  unlike  the  Memory  for  Sen¬ 
tences  Test,  measures  the  recognition  type  of  memory,  not 
the  recall  type. 

It  measures  Immediate  memory.  Thera  are  no  other  tests 
Intervening  between  the  study  period  and  the  test  period, . as 
there  are  In  the  case  of  the  Memory  for  Sentences  Test. 

The  material  to  be  learned  is  someidiat  less  meaningful 
than  that  of  the  Memory  for  Sentences  Test,  since  half  of ' 
ecu:h  pair  of  terms  to  be  associated  Is  an  arbitrary  verbal 
symbol. 

As  for  the  similarities  between  the  Memory  for  Words 
Test  and  the  Memory  for  Sentences  Test,  both  test  deliberate 
memorlzatloi^  not  Incidental  memory;  and  both  measure  memory 
for  some^diat  "luiderleamed"  materials  rather  than  for 
"overleaxned"  materleds. 

!Ihere  Is  considerable  presumptive  evidence.  Inherent 
In  the  nature  of  the  tahk,  that  the  -ability  measvired  by  the 
Memory  for  Words  Test  Is  one  that  Is  very  useful  In  learning 
a  foreign  language.  In  other  words,  the  test  has  excellent 
"face  vsLlldlty"  as  a  measure  of  aptitude  for  foreign  lan¬ 
guages.  As  has  been  Indicated,  this  face  validity  Is 
bolstered  by  considerable  empirical  evldehce  (obtained 
chiefly  In  connection  with  the  Paired  Associates  Test  of 
the  Psl  Lambda  battery) . 


vli-53 


niere  Is  also  good  presusqptlve  evidence  that  the  test 
would  be  a  useful  predictor  of  ability  to  learn  many  kinds 
of  code.  (After  hll^  the  task  Ingposed  by  the  test  ^  a  form 
of  code  learning.) 

Rote  memory  is  also  obviously  useful  In  many  other  kinds 
of  occupational  endeavor. 

D.  Djjsgulsed  Words  test 

Purpose  of  test.  Hiis  test  Is  designed  to  measure 
idiat  has  been  tensed  "phonetic -orthographic  ability— the 
ability  to  form  connections  between  letters  euid  sounds”  (2). 

Historical  antecedents.  A  test  In  \dilch  the  tsusk  was 
to  declidier  vorda  spelled  in  a  partially  i^onetlc  euid  very 
much  abbreviated  form  was  used,  about  20  years  ago  as  a  part 
of  the  Turse  Shorthand  Aptitude  Test  (12)*  This  test  was 
demonstrated  to  be  useful  for  Its  Intended  purpose  of  pre¬ 
dicting  ability  to  learn  shorthend. 

Ihe  task  described  above  used  in  the  Turse  Shorthemd 
Aptitude  Test,  was  converted  to  a  slightly  more  complex  task 
which  could  be  measured  by  multiple-choice  items,  in  the 
Spelling  Clues  Test  (Test  3  of  the  Psi-Lambda  Foreign  Lan¬ 
guage  Aptitude  feattei^)  ,  In  this  version  the  task  was 

to  figure  out  what  word  was  represented  by  the  odd  comiblnatlon 
of  letters  and  then  to  demonstrate  that  one  had  translated 
correctly  by  picking  the  correct  synonym  from  among  five 
choices.  CsurroU  obtained  empirical  evidence  that  his 
Spelling  Clues  Test  was  useful  as  a  predictor  of  foreign 
Ismguage  learning  ability. 

Description  of  Talent  Disguised  Words  Test.  This  test 
uses  the  same  type  of  item  as  the  Spelling  Clues  Test 
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described  above^  with  the  minor  difference  that  In  the  case 
of  the  Talent  Test  a  systematic  effort  mas  made  to  reduce 
the  vocabulary  level  of  the  words  "spelled”  by  limiting 
these  words  to  approximately  the  first  ^^000  in  the  "Teacher's 
Word  Book  of  30,000  Words",*  which  shows  the  order  of  fre¬ 
quency  with  which  words  are. used  In  written  fiigllsh.  .The 
reason  for  Imposing  this  restriction  was  to  reduce  to  a 
minimum  the  extent  to  \dilch  the  test  measures  vocabulary 
level,  since  there  was  already  a  separate  vocabulary  scale 
In  the  battery,  (incorporated  In  the  Information  Test). 


*Thomdike,  R«.L.,  and  Lorge,  I.  The  teacher's  word  book 
of  30,000  words.  New  York.  Teachers  College,  Columbia 
University,  (The  words  used  were  limited  to  those 

designated  AA,  A,  or  l4-49  in  the  0  column  of  the  word 
list.) 


The  directions  for  the  test  read  as  follows : 

"Each  Item  begins  with  a  word  which  is  disguised 
by  spelling  it.  In  a  very,  peculiar  way.  However, 
It  Is  spelled  somewhat  as  it  is  pronounced.  The 
disguised  word  Is  followed  by  five  real  words  or 
phrases..... Show  that  you  recognize  the  disguised 
word  by  selecting  the  choice  that  means  most 
nearly  the  same  thing. . " 

Two  saoq;)le  items  follow: 

Item  42.  .caCRUD 

A.  depressed 

B.  described 

C.  thrown  away 

D.  ruined 

E.  accused 


(The  answer  Is  A,  since  the  disguised 
word  is  "discouraged".) 


A.  sadly 

B.  postpone 

C.  .  bluntly 

D.  hand  out 

E.  every  day 

(The  answer  Is  B,  since  the  disguised 
word  Is  "delay".) 

Perhaps  citing  some  of  the  rules  that  had  to  be  con¬ 
formed  to  in  writing  the  items  will  give  a  clearer  idea  of 
the  character  of  the  test. 

The  following  were  the  only  acceptable  ways  of  dis¬ 
torting  the  spelling: 

1.  Replacing  non-phone tic  spelling  of  the  word  with 
phonetic  spelling  (or  with  approximately  phonetic  spelling) . 
For  Instance:  . 

Item  44.  STRAT 

A.  straddle 

B.  without  curves 

C.  avenue 

D.  swagger 

E.  historical 

(in  the  above  item,  STRAT  replaces 
"straight".) 

2.  Making  other  changes  in  the  spelling  that  will 
not  change  it  from  phonetic  to  non-phonetic .  For  Instance 
"k"  ml^t  be  substituted  for  "c",  "J"  for  "g",  "z"  for  "s", 
etc.,  where  such  cheuiges  are  con^iatible  with  the  correct 
pronunciation  of  the  word. 

3.  (knitting  vowels,  where  the  appropriate  vowel  pro¬ 
nunciation  is  included  in  the  correct  pronunciation  of  the 
name  of  a  letter  in  the  appropriate  position  (e.g.,  "cable" 
mi^t  be  spelled  KBL.  Note  that  the  "A"  sound  in  "cable" 
would  be  Included  in  the  pronunciation  of  the  name  of  the 
letter  "K"). 


4.  Unstressed  vowel  sounds  may  also  be  omitted  (e.g., 
"bitter"  might  be  spelled  BITR,  thus  omitting  the  unstressed 
vowel  "E"  In  the  second  syllable)* 

.5*  In  some  cases  even  a  stressed  vowel  (e.g.,  the 
vowel  In  the  second  syllable  of  "discouraged"  In  Saaqple 
Item  42)  may  be  omitted,  when  the  disguised  word  Is  auffl- 
oiently  long  to  permit  positive  identification  even  without 
the  vowel  sound. 

The  additional  rule  was  Imposed  that  if  possible  the 
definition  of  the  word  should  not  be  so  explicit  that  the 
examinee  could  work  backwards  from  the  options  emd  thus 
decipher  the  disguised  word  very. easily.  .Consider,  for 
Instance,  the  following  Item: 

Item  45.  SIDR 

A.  frozen  water 

B.  instrument  for  writing  in  ink 

C.  fermented  grape  Juice 

D.  candy  made  from  cacao  beans 

E.  apple  Juice 

(The  answer  is  E.) 

The  student  might  have  no  Idea  what  SIBR  Is,  but  he 
could  examine  the  options,  translate:.them  to  "ice",  "pen", 
"wine",  "chocolate",  and  "cider"  respectively,  8uid  then 
eeuilly  see  that  Option  E  Is  the  one  disguised  as  SIBR. 
Hxerefore  the  following  version  of  the  Item,  which  is  per¬ 
haps  a  little  harder,  ml^t  be  preferable  for  purposes  of 
this  test.  In  order  to  maximize  the  deciphering  aspect  eind 
minimize  the  vocabulary  aspect  in  determining  the  answer. 

Item  46.  3IBR 

A.  sorrowful 

B.  law  violator 

C.  measurement 

D.  sheidow 

E.  beverage 


(The  euiswer  Is  E.) 


It  has  already  been  pointed  out  that  the  Items  are  not 
intended  to  measure  vocabulary  level  directly,  .  except  to  a 
very  limited  degree*  .Nor  are  they  Intended  to  measure 
spelling  ability,  (ibils,  too,  Is  measured  directly  ty  another 
test  In  the  battery.) 

What  this  test  does  measure  Is  probably  somewhat  re¬ 
lated  to  a  kind  of  ability  to  become  tused  to  "strange"  modes 
of  spelling  that  would  be  useful  In  learning  shorthand  or  a 
foreign  language.  Since  the  exact  ways  In  which  the  spelling 
Is  distorted  are  not  specified  explicitly  In  the  directions, 
\diat  is  measured,  to  a  considerable  extent,  is  ability,  to 
draw  Inferences  of  a  type  that  would  be  drawn  in  learning 
to  read  a  foreign  language.  The  ability  to  puzzle  out, 
from  context  and  appearance,  the  meaning  of  a  word  \dilch  Is 
vaguely  reminiscent  of  a  familiar  English  word  is  probably 
rather  closely  related,  to  the  ability  measured  ly  this 
test. 

While  scores  on  the  test  ceui  reasonably  be  expected 
to  be  related  to  foreign  language  aptitude,  peidiaps  a  word 
of  caution  Is  In  order,  to  the  effect  that  this  aptitude  Is 
a  complex  of  abilities,  and. no  single  test  can  give  a 
definitive  euiswer  to  the  question  of  whether  someone  csun 
succeed  In  all  aspects  of  learning  any  foreign  language. 

E.  ftagUsh  Test 

.Purpose  of  test.  The  purpose  of  this  test  Is  to 
measure  ability  to  esquress  oneself  aAsquiiitely  In  SogUsh. 

Five  sepsucate  subscpres  are  obtained— spelling,  capital¬ 
ization,  punctuation,  English  usage,  and  effective  e^qiresslon- 
to  measure  five  separate  aspects  of  ability  in  English. 
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nie  test  is  Intended  to  provide  measvtres  of  general  achieve¬ 
ment  In  the  area  of  English. 

Historical  antecedents .  Standardized  spelling  tests 
go  bach  a  long  way.  In  l897  several  versions  of  a  8i>elllng 
test  were  administered  to  about  20,000  students  (ll). 

Since  then  many  different  kinds  of  objective  test 
Items  have  been  used  to  measure  spelling  ability.  There 
have  been, some  eu^jirlcal  .studies  (lo)  to  determine  whether 
Items  irtiich  test  ability  to  recall  the  correct  spelling  of 
words,  by  requiring  students  to  actually  write  out  the  words 
to  show  that  they  know  how  to  spell  them,  are  superior  to 
Items  of  the  kinds  used  In  most  standardized  spelling  tests, 
\rtxich  "merely”  test  recognition  of  correct  spelling.  These 
Items  may  require  the  student  to  Identify  which  of  a  long 
list  of  words  are  misspelled,  or  to  decide  which  one  of 
several  ways  of  spelling  a  single  word  Is  the  correct  way, 
or  to  pick  out  the  one  word  out  of  four  or  five  choices 
that  has  been  misspelled.  The  outcome  of  all  this  experi¬ 
mentation,  In  the  opinion  of  the  present  writers.  Is  that 
while  the  various  types  of  Items  probably  differ  sometdiat 
in  their  efficiency  (reliability  In  relation  to  the  eunount 
of  testing  time  required),  there  Is  little  difference  among 
them  In  regard  to  the  nature  of  the  ability  measured. 

Neither  of  the  two  basic  types  of  spelling  test  (recall  emd 
recognition)  Is  outstandingly  superior  to  the  other.  Ihus 
the  decision  on  idilch  to  use  may  have  to  rest  on  the  peurtlc- 
ular  administrative  coi^itions  and  other  circumstances  (time 
available,  scoring  facilities,  etc.). 

There  has  also  been  considerable  experimentation  with 
different  types  of; items  to  measure  the  other  aspects  of 
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English  achievement  besides  spelling. 

^  Description  of  Talent  English  Test.  The  Talent  Bigllsh 

Test  has  five  separately  scored  parts: 

¥ 

1 .  Spelling 

f  2.  Capitalization 

3*  Pvinctuatlon 

*  k.  English  usage 

5«  Effective  expression 

The  test  Is  primarily  concerned  with  written  English, 
but  presumably  some  generalization  to  spoken  English  on  the 
basis  of  the  English  Usage  and  Effective  Expression  sub¬ 
scores  is  justifiable. 

Each  of  the  five  parts  of  the  test  Is  discussed  In 

turn. 

1.  Spelling.  Each  Item  consists  of  four  words,  of 
-  irtilch  one  may  be  misspelled.  The  task  Is  to  determine  \dilch 

^  one  of  the  four,  If  ahy.  Is  misspelled.  Below  are  three 

sample  Items : 

♦ 

Item  47.  .  .  t 

A.  excellent 

B.  exercise 

C .  exstract 

D.  extreme 

E.  None  of  the  above. 

Item  48. 

A.  affection 

B .  complexion 

C.  electrician 

D.  permission 

B.  None  of  the  above 

Item  49 » 

•*>  A.  uncle 

B.  nlckle 

C.  label 

D.  villain 

E.  None  of  the  above 

(The  answers  to  these  three  Items  are 
C,  E,  and  B  respectively.) 
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The  Spelling  subtest  Is  Intended  to  neasure  ability  to 
spell— not  size  of  yocabuleuy.  Students  idio  do  not  have 
especially  large  vocabularies  but  vho  are  able  to  spell 
most  of  the  words  they  have  encountered  should  get  a  good 
score.  Therefore  the  test  measures  ability  to  spell  reason¬ 
ably  common  words— words  that  have  probably  been  encountered 
at  least  once  by  sQmost  all  of  the  students .  Note  that  the 
words  are  not  necessarily  ones  that  the  students  cem  define 
precisely  or  even  loosely,  (it  is  possible  for  good 
spellers  to  know  how  to  spell  words  they  do  not  exactly 
understand.)  To  Instire  that  the  vocabulary  would  not  be 
too  difflc\ilt,  the  words  tested  were  limited  to  the  10,000 
used  most  frequently  in  written  English,  according  to  the 
Thorndike -Lorge  word  list,*  PurthermoreJ.  because  this  sub¬ 
test  is  designed  to  measure  spelling  ability,  not  exactitude 
of  vocabulary,  no  attenqpt  is  made  to  penalize  students  for 
misconceptions  about  the  pronxmclatlon  of  words  (e.g., 
"larcency"  for  "larceny”,  "Irrevelant"  for  "Irrelevant", 
"Pebuary"  for  "Februaiy" ,  etc . ) . 


•*Thorndlke,  E.  L.,  and  Lorge,  I.,  The  Teacher's  Vford  Book 
of  30.000  Words,  Teswjhers  College  Bureau  of  Publications, 
New  York,  1944. 


What  is  actusQJLy  measured  directly  by  the  test  is 
ability  to  recognize  correct  spelling  suid  Incorrect  spelling 
rather  than  the  ability  to  recall  how  a  word  is  spelled 
idien  given  no  visual  clues  (or  siiscues)  at  sdl. 

Except  in  the  case  of  such  activities  as  proofreading 
and  editing,  the  ability  to  spell  correctly  idien  writing 
Is  generally  more  Isqportant  than  the  ability  to  recognize 


spelling  errors  when  one  is  not  writing.  It  mlg^t  appear 
superficially  that  the  ability  to  recognize  spelling  errors 
Is  all  that  Is  measured  by  this  test.  It  Is  belleyedj.  ho^r- 
Wer,  that  the  ability  to  recall  correct  spelling— In  other 
words  actvially  to  spell  correctly— Is  also  measured, .  since 
the  correlation  between  the  two  j^s  undoubtedly  hlgd^,  emd 
since  the  test  was  administered  In  such  a  vay  that  the 
correlation  Is  probably  enhanced.,  (This  was  achieved  by 
providing  the  students  with  scratch  paper— for  the  conven¬ 
ience  of  those  students  who,  \dien  they  are  In  doubt,  about 
the  correct  spe3J.lng  of  a  word,  like  to  write  it  out  in  the 
various  ways  under  consideration.) 

Thtis  irtiat  is  mea8\ired  directly  by  the  test  Is  ability 
to  recognize  spelling  errors  when  presented  with  the  visual 
stimulus,  while  the  actual  ability. to  spell  a  word  correctly 
when  writing  It  is  probably  tapped  Indirectly.  No  effort 
is  made  to  meastire  the  ability  to  spell  orally  in  the  ab¬ 
sence  of^'any  visual  stimulus.  !IMs  ability  Is  Inherently 
a  rather  unln^jortant  aspect  of  spelling.  Furthermore,  It 
seems  probable  that  It  has  a  sizable  correlation  with  the 
spelling  abilities  that  are  measured. 

. In  the  interests  of  maximizing  the  efficiency  of  the 
battery  as  a  idiole,  an  effort  was  made  to  keep  to  a  minimum 
the  extent  to  which  spelling  scores  would  be  correlated 
with  general  Intelligence,  which  Is  covered. adequately  by 
other  tests  in  the  battery.  In  order  to  keep  the  corre¬ 
lation  with  Intelligence  at  a  minimum,  uhonetlc  spelling 
errors  were  used  (i.e.,  errors  ^ich  would  still  permit 
the  word  to  be  pronounced  correctly  if  it  were  pronounced 
as  spelled)  rather  than  non-phonetic  spelling  errors. 
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Elimination  of  non-phonetic  errors  is  Justified  on  the 
grounds  that  those  who  neike  such  errors  are  also  prone  to 
phonetic  errors  if  these  are  the  only  kind  offered,  .nils 
is  in  euicordance  with  the  findings  of  Dailey  and  Mays.  (5) 


(An  exaaq?le  of  a  phonetic  error  is  "exstract”  for  "extract". 
-A  non-phonetic  error  wovild  be  "ectract"  for  "extract",) 

When  words  which  are  not  pronounced  as  they  are  spelled 
were  included,  the  misspelling  was  in  the  direction  of 
making  the  word  more  phonetic  (e.g.,  attumey,  sargeant). 

nie  eitg;>hasle  in  all  cases  was  on  words  that  present  a 
problem  of  some  sort  in  regard  to  their  spaUioE^  rather 
than  on  words  yhoBe  spelling  is  perfectly  straightforward 
and  present!  no  difficulties. 

A  spelling  test -was  included  in  the  battery  for  two 
reasons.  In  the  first  place,  the  kind  of  achievement 
measxured  by  ...this  test  is  Inherently  Important.  Hie  ability 
to  spell  eidequately  is  necessary  in  order  to  be  able  to 
write  acceptable  English.  This  ability  is  essential  for 
many  types  of  Jobs — e.g.,  secretary,  typist,  etc.  The 
ability  to  recognize  spelling  errors  is  also  directly 
necessary  in  many  Job  activities— e.g.,  proofreading, 
editing,  etc.  Most  fundamentally,  however,  correct  spelling 
is  a  central  pa^  of  the  manifest  culture  of  an  educated 
person. 

The  second  major  reason  for  including  spelling  in  the 
battery  was  that  its  correlation  with  many  other  aptitude 
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tests  Is  quite  low,  and  that  therefore  it  could  be  esqpected 
to  contribute  a  large  unique  con^nent.  Relatively  little 
10.  known;  about  what  spelling  ability  actually  consists 
of  (e.g.^  to  ^at  extent  It  depends  on  visual  neinory,  visual 
perception,  auditory ^visual  association,  etc.),  but  there 
Is  evldenqe  that  Its  Inclusion  In  a  batteiy  contributes 
significantly  to  the  battery's  validity  for  a  nvunber  of 
purposes. 

2.  Capitalization.  This  test  consists  of  a  passage 
printed  entirely  In  small  letters.  The  task  Is  to  deter¬ 
mine  which  of  the  words  with  numbers  under  them  should 
start  with  a  capital  letter. 

Below  Is  a  sample  passeige  with  36  Items: 

george  hathaway  spent  last  november  In  parls 

50  51  52  53  5^ 

with  his  brother  henry  and  their  yoving  cousin, 

55  56  57  58  59  60 

louls  beauregardj  they  stayed  In  rather  a  large 

61  62  63  6k  65  66 

hotel  overlooking  the  seine  river.  In  december 

67  68  69  70  71  72  73 

they  all  went  to  england  (to  london,  1  believe), 

74  75  76  77  78 

where  they  spent  Christmas  with  dr.  and  mrs. 

79  80  81  82  83  8k 

hathaway. 

85 

(Answers:  The  words  to  be  capitalized  eu:e 
Nos.  50,  51,  53,  5k,  57,  61,  62,  70,  71, 

72,  73,  75,  77,  78,  82,  83,  8k,  85.) 

3.  Punctuation.  The  Punctuation  subtest  has  two 
parts — Section  a  (Punctuation  Marks)  and  Section  b  (Sen¬ 
tence  Structure) . 

In  Section  ^  each  Item  consists  of  a  sentence  In 
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irtilch  a  section  Is  printed  without  punctuation.  This  section 
of  the  sentence  Is  then  presented  punctuated  In  several  al¬ 
ternative  ways.  The  task  Is  to  determine  :fAlch  of  the  ways 
presented  Is  correct.  A  .'sample  Item  follows: 

Item  86.  How  blue  the  sky  has  tvimed 

A.  sky  has  tpmed. 

B.  sky  has  turned  2 

C.  sky  has  turned? 

D.  sky^  has  turned. 

E.  sky;  has  turned. 

(The  answer  Is  B.) 

The  purpose  of  Section  a  Is  to  test  knowledge  of  'the 
appropriate  use  of  all  standard  punctuation  meurks :  period, 
comma,  semi-colon,  colon,  apostrophe,  single  quotes,  double 
quotes,  question  mark,  exclamation  point,  dash,  paren-theses, 
hyphen.  While  the  examinee  Is  required  to  differentiate 
between  correct  and  incorrect  punctuation,  he  Is  not  re¬ 
quired  to  determine  \dilch  of  t'wo  or  aore  acceptable  or 
defensible  manners  of  punctuation  Is  preferable.  For  In¬ 
stance,  no  effort  is  made  to  test  whether  -the  student 
recognizes  cases  where  although  a  period  Is  grammatically 
correct,  a  semi-colon  would  be  preferable;  nor  Is  any 
effort  made  to  test  whether  the  student  has  the  same 
preference  as  the  item  writer  in  cases  ^ere  either  commas, 
dashes,  or  peu’entheses  are  technically  acceptable.  Such 
decisions  Involve  refinements  of  style,  and  as  such  are 
matters  about  which  there  might  be  considerable  difference 
of  opinion  among  e]q>ert  writers.  Knowledge  of  correct 
capitalization  Is  not  'tested  in  these  Items,  since  it  .Is 
co'vered  In  a  separate  section  of  the  test. 

In  Section  ^  eeu:h  Item  consists  of  either  a  fragment 
of  a  sentence,  a  complete  sentence,  or  two  or  more  sentences 
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run  together.  Hie  task  is  to  determine  irtxlch  it  is. 

The  directions  are  to  mark  the  euisver  sheet  as  follows: 

Mark  "0"  if  it  is  part  of  a  sentence. 

Mark  "1”  if  it  is  one  complete  sentence. 

Mark  ”2''  if  it  is  two  or  more  sentences  run 
together. 

Four  sample  items  follow: 

Item  87.  A  course  of  study  including  English, 
French,  algebra,  American  history, 
and  chemistry. 

Item  88.  The  football  team  having  tied  one  game 
and  won  all  the  rest. 

Item  89.  Try  this,  it  will  help  you. 

Item  90.  Do  you  know  how? 

(The  answers  are  0,  0,  2,  and  1  respectively.) 

The  function  of  this  section  is  to  determine  whether 
the  student  has  mastered  the  concept  of  vb&t  constitutes  a 
sentence— includitig  the  fact  that  every  sentence  or  clause 
has  a  subject  and  a  predicate.  Mastery  of  this  concept  is 
essential  in  order  to  be  able  to  write  acceptable  English. 

4.  English  Useige.  Each  item  consists  of  a  sentence 
with  a  word  or  group  of  words  missing,  the  missing  section 
being  represented  by  a  blank.  The  task  is  to  determine 
\rtiich  of  several  (three  to  five)  choices  fits  in  the  blank 
best.  The  instructions  specify  that  if  two  choices  are 
correct,  the  better  one  is  to  be  selected. 

Here  are  two  sample  items: 

Item  91.  Bob  _ eurrange  it. 

A.  mi^t  could 

B.  mig^t  be  able  to 

C.  could  maybe 

D.  maybe  could 

E.  would  maybe  be  able  to 


(The  answer  is  B.) 
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Item  92.  Ed  euad  _______  plauinlng  to  go  . 

A.  .  myself  was 

B.  me  was 

C.  I  was 

D.  myself  were 

E.  I  were 

(Ihe  answer  is  E.) 

The  Items  measiire  knowledge  of  correct  English  usage 
and  knowledge  of  the  hest  way  of  expressing  a  given  Idea. 
Knowledge  of  vocabulary  Is  not  to  be  measured  In  this 
section^  since  that  Is  measured  elsevdiere  In  the  battery. 
What  ^  to  be  measvired  Is  knowledge  of  preferred  usage. 

The  student  Is  not  required  to  determine  In  absolute  terms 
whether  any  particular  usage  Is  definitely  IncorfSbt  or 
irtiether  on  the  other  hand  It  is  marginally  acceptable  and 
merely  undesirable.  Instead^  the  student  Is  required  to 
decide  which  of  seveial  options  provides  the  best  (gram¬ 
matically  correct>  clearest,  most  unambiguoxis,  least 
awkward)  way  of  expressing  a  particuleur  idea.  In  Sample 
Item  91#  for  instance,  although  Options  C,  D,  and  E  are, 
not  technically  Incorrect,  they  do  represent  an  unidlomatlc 
and  therefore  awkward  word  order.  ("Maybe  Bob  could  arrange 
it"  would  be  a  less  awkward  word  order  than  any  of  the 
sequences  in  which  the  word  "Bob"  precedes  the  word  "maybe".) 

5.  Effective  Expression.  Each  Item  consists  of 
three,  four,  or  five  sentences,  each  e^qpresslng  the  same 
Idea,  but  only  one  of  them  expressing  It  well.  The  student 
Is  to  pick  ^Ich  of  the  sentences  expresses  the  idea  best. 

(He  Is  given  no  hint  as  to  idiat  criteria  to  use  in  making 
his  decision.) 

A  saoqple  item  follows: 
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Item  9S» 

A.  nilngs  such  as  this  helped  our  fore- 
fathors  push  back  the  vllderQess,  and 
create  the  richest  nation  In  the  world. 

B.  Our  forefathers  created  the  richest 
nation  in  the  world^Mhelped  by  thln^ 
like  this  to  push  back  the  wLldemess. 

C.  .'Things  such  as  this  helped  our  fore¬ 
fathers  in  their  pushing  back  of  the 
wUdemesB  and  In  their  creation  of  the ' 
richest  nation  in  the  world. 

B.  To  create  the  richest  nation  In  the 
world,  our  forefatheis,  being  helped 
by  things  like  thlS;  pitted  back  the 
wilderness. 

(The  answer  Is.  A.) 

These  Items  are  .  used  to  meas\ire  recognition  of  good 
prose  expression— l.e.,  sentences  which  express  ideas 
clearly,  concisely, .  and  smoothly.  To  do  well  on  this  sub- 
test,  the  student  must  reject  sentences  which  egress  an 
idea  ambiguously,  awkwaidly,  or  unduly  wordily.  He  is  not 
required  to  determine  whether  the  preferred  sentence  rep¬ 
resents  the  best  possible  way  of  expressing  the  idea.  He 
need  only  choose  among  the  sentences  given. 

The  items  do  not  test  the  ability  to  recognize  siaple 
gramnatlcal  errors,  since  this  lA  (Mwaared  in  the  English 
.Usage  suhtest,  nor  do  they  test  kiiowledge  of  punctuation, 
since  this  likewise  Is  covered  in  a  sepeurate  score. 

E.  -Word  Functions  in  Sentences  Test 

Purpose  of  test.  This  test  Is  Intended  to  measure  a 
person's  sensitivity  to  grammatical  structvire,  whether  or 
not  he  has  had  fonoal  Instruction  In  the  rules  of  graaanr. 

Historical  antecedents.  This  lype  of  test  was  orig¬ 


inated  only  a  few  years  sigo,  by  John  B.  .  Carroll,  who  designed 
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It  as  a  measure  of  foreign  language  aptitude,  and  liuior- 
porated  It  In  his  Fal-Iambda  Foreign  language  Aptitude 
Battery  as  Test  U  (Wbrds  In  Sentences) .  It  lias  proved  to 
have  excellent  validity  as  a  predictor  of  foreign  language 
learning  ability.  For  Instance,  using  tbe  same  criterion 
(course  grades  In  an  Intensive  Air  Force  "trial  course" 
In.Msndarln  Chinese)  as  has  already  been  mentioned  In 
connection  with  the  Faired  Associates  Test  of  the  Fsl- 
Lsmbda  Battery,  Carroll  demonstrated  that  the  Words  In 
Sentences  Test  helped  predict  this  criterion,  and.s^ttrlb- 
uted  this  result  chiefly  to  a  common  "linguistic  Interest" 
factor. 

Description  of  Talent  Word  Functions  In  Sentences 
TestT  This  test  uses  the  same  type  of  Item  as  :the  Words 
In  Sentences  Test  (Test  4  of  the  CarroU^Sapon.  Fsl-Lambda 
Battery) ,  mentioned  above. 

Each  Item  consists  of  a  "key  sentence",  followed  by 
one  or  more  other  sentences.  The  key  sentence  always  has 
a  word  or  phrase  printed  In  capital  letters,  and  the  task 
Is  to  determine  which  of  the  five  luiderllned  words  or 
phrases  In  the  following  sentence (s)  performs  the  same 
function  In  Its  sentence  as  the  word  or  jhxase  in  capltsds 
performs  In  Its  sentence. 

Three  sao^le  Items  follow* 

Item  9^«-.  They  walked  OAILI  down  the  street. 

The  newljr  arrived  covqple  used  up  their 

money  too  fast. 

COX 
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Item  95.  HAVING  an  optimistic  nature,  she  ex¬ 
pected  things  to  turn  out  veil. 

Driving  a  car  requires  a  license. 

A 

Ibe  veather  having  finally  cleared  up, 

B 

Mrs.  Bogers  vas  ahle  to  work  In 
her  garden. 

Helen,  busily  planning  her  afternoon, 

C 

wasn't  watching  \diere  she  was  teolng. 
D  E 

Item  96.  This  is  the  WAY  to  do  it* 

I  do  it  a  different  way. 

A 

I  use  a  different  method. 

B 

The  way  to  do  it  is  like  this. 

C 

That's  the  wrong  method. 

D 

There  are  many  ways  of .doing  it. 

E 

(The  answers  to  these  three  items 
are  E,  C,  and  D  respectively.) 

This  is  a  very  difficult  test  for  most  students.  It 
was  made  difficult  deliberately,  since  there  is  reason  to 
believe  a  hard  test  would  predict  ability  to  learn  foreign 
languages  better  than  an  easier  one. 

Althou^  formal  training  in  grammar  and  previous  stud;/- 
of  foreign  languages  (particularly  of  hlgdily  inflected  ones, 
like  Latin)  sire  probably  of  some  help  on  -this  test,  -the 
fact  -that  -the  teiminology  of  greoDar  is  not  used  at  all 
contributes  to  redvicing  -the  effects  of  formal  training  -to 
a  minimum.  To  perform  well  on  -the  test,  one  must  unders-tand 
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something  about  the  structure  of  a  sentence^  and  recognize 
the  function  of  each  word  or  phrase  In  the  sentence. 

Ihe  ability  measured  by  the  test  is  probably  related 
to  the  ability  to  learn  the  grammar  and  characteristic  sen¬ 
tence  structtire  of  a  foreign  language— particularly  a  heavijr 
Inflected  language  (s\ich  as  Latln^  for  Instance)  In  \dilch 
word  order  is  typically  very  different  from  that  of  English. 
It  Is  probably  also  related  to  the  ability  to  learn  the 

') 

formal  rules  of  English  grammeir. 

A  relationship  has  been  demonstrated  between  scores  on 
this  type  of  test  and  the  ability  to  learn  a  foreign  lan¬ 
guage.  Nevertheless,  since  this  test  measures  only  one 
aspect  of  that  very  complex  ability,  a  high  score  on  the 
test  does  not  guarantee  success  in  mastering  a  foreign  lan¬ 
guage.  But  considered  in  conjunction  with  other  relevant 
tests,  the  Word  Functions  in  Sentences  Test  should  prove 
very  useful  as  a  predictor. 

G.  Reading  Comprehension 

Purpose  of  test.  The  purpose  of  the  test  is  to  measure 
ability  to  comprehend  written  materials  dealing  with  various 
kinds  of  subject  matter. 

■Historical  antecedents .  Althou^  numerous  types  of 
steuidsrdlzed  reading  tests  have  been  used  over  the  last  to 
years,  by  far  the  most  commonly  used  type  is  the  one  that 
consists  of  passages  to  be  read,  with  each  passage  followed 
by  several  multiple-choice  questions  testing  conqjrehenslon. 
In  answering  the  questions  the  student  is  usually  permitted 
to  refer  back  to  the  passage  as  often  as  he  likes. 
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Description,  of  !I!alent  Refiuiing  Comorehension  Teat.  The 


Talent  Test  is  of  the  type  described  in  the  preceding  paxa- 
graidi.  Ihe  peussages  cover  a  wide  reuige  of  topics >  Incltiding 
some  dealing  with  social  studies^  some  dealing  with  natural 
science,  8uid  some  vhich  are  of  a  literary  character.  .Poetry 
as  well  as  prose  Is  Included. 

.  A  jpoem  ^and  some  sample  items  based  on  it  follow: 

(1)  Loveliest  of  trees,  the  cherry  now 

(2)  Is  hung  with  bloom  along  the  bough 

(3)  And  stands  about  the  woodland  ride 
Wesuring  white  for  Eastertide. 

(5)  Now,  of  my  threescore  years  and  ten, 

(6)  Twenty  will  not  cone  again, 

.  (7)  And  take  from  seventy  springs  a  score, 

(8)  It  only  leaves  me  fifty  more. 

(9)  And  since  to  look  at  things  in  bloom 

(10)  Fifty  springs  eure  little  room, 

(11)  About  the  woodlamds  li.wlll  go 

(12)  To  see  the  cherry  hung  with  snow. 

Item  97.  What  kind  of  tree  is  the  poem  about? 

A.  White  pine 

B.  White  birch 

C.  White  oak 

D.  Cherry 

E.  None  of  these 

Item  98.  What  does  the  word  "ride"  probably 
mean,  as  used  in  line  3? 

A.  .Auto  ride 

B.  Tree 

C.  Horseback  ride 

D.  Flowers 

E.  Road 

Item  99.  What  season  is  it,  in  the  poem? 


A.  Winter 

B.  Spring 

C.  Suimner 

D.  Fell 

E.  Ihere  is  no  way  of  telling. 

Item  100.  The  poet  indicates,  a  little  ruefully, 
that  his  life 


A.  will ^pass  too  quickly. 

B.  will  probably  end  very  soon. 

C.  has  been  imhappy. 

D.  has  been  devoid  of  beauty. 

E.  has  been  xmeventful. 
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Item  101.  How  old  does  the  poet  say  he  Is? 

A.  20 

B.  .30 

C.  4o 
D»  50 
E.  .70 

Item  102.  When  the  poet  says  he  "will  go"  (line 
11),  he  probably  means  he  will  go 

A.  on  foot. 

B.  by  boat. 

C .  by  automobile . 

D.  by  horse-drawn  slelj^i. 

E.  on  snowshoes  or  skis. 

Item  10^.  The  poet  expresses  a  liking  for 
looking  at 

A.  snow-covered  trees. 

B.  snow-covered  gro\ind. 

C.  spring  blossoms. 

D.  autumn  leaves. 

E.  Easter  lilies. 


Item  104.  What  does  the  poet  se^  are  the 
loveliest  trees? 

A.  Any  \dilte  trees 

B.  Any  trees  In  bloom 

C.  Cherry  trees 

D.  Any  woodland  trees 

E.  He  doesn't  say. 

(The  answers  axe  D,  E,  B>  A,  A,  A, 

C,  emd  C  respectively.) 

It  Is  Important  to  note  that  what  the  test  measures 
Is  the  ability  to  read  with  comprehension,  rather  than  mere 
ability  to  mouth  or  recognize  the  printed  word  without 


understanding  the  fact,  idea,  or  concept  that  the  writer 


is  attempting  to  convey. 

Reading  cosprehension  skills  have  been  classified 
Into  the  following  nine  categories:* 


*I)avls,  F.  B.,  "Fundamental  Factors  of  Coopr^ension  in 
-Reading",  Psychometrlka.  1944,  185-I97. 
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1.  Kiiovledf^  of  vprd  BeaalngB. 

2.  Ability  to  select  the  appropriate  swaoizig  for 
a  vord  or  a  phrase  in  lAxe  light  of  its  parties 
ular  contextual  setting* 

3*  Ability  to  follov  the  organization  of  a  passage 
and  to  identify  aateeedents  axid  references  in  it* 

4*  Ability  to  select  the  laain  thought  of  a  passage. 

3.  Ability  to  answer  questions  that  are  specif!** 
cally  answered  in  a  pusage. 

6.  Ability  to  answer  questionii  that  are  answered  in 
a  passage  but  not  in  the  words  in  which  the  ques«* 
tion  is  asked* 

7.  Ability  to  draw  inferences  from  a  passage  about 
its  contents. 

8*  Abili-^  to  recognize  the  literary  derlces  used 
in  a  passage  to  deteroilne  its  tone  and  mood. 

9.  Ability  to  determine  a  writer’s  purpose,  in** 
tent,  and  point  of  view,  l.e.,  to  draw  in¬ 
ferences  about  a  writer* 

Of  these  nine  categories,  all  but  the  first  is  covered 
directly  by  items  in  this  test*  Knowledge  of  word  meanings  is 
measured  in  the  Information  Test  Vocabulary  Scale  and  therefore 
is  not  measured  directly  in  the  Beading  Compr^ension  Test*  To 
a  certain  extent,  however,  it  is  unavoidable  that  it  will  affect 
Reading  Co]iq>rehension  scores,  since  the  vocabulary  of  the  pas¬ 
sages  and  questions  must  be  reuoxiably  well  understood  if  the 
Items  are  to  be  answered  correctly.  But  extremely  dlfflcvilt 
vocabulary  has  been  systematically  avoided. 

In  general,  the  vocabulary  is  within  the  first  13,000 
words  on  a  word  frequency  count  such  as  the  Thonidike-Lorge 
list.’’  The  primary  exceptions  to  this  llaitaticm  would  be 


«Thomdlke,  E.  L.,  and  Lorge,  I.,  nm  ThawauMf’s  Word  Book 
^  30*000  Words*  Teachers  College  Bureau  oflhblication. 
New  York,  ISW. 


m 
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words  whose  meaning  is  explained  in  the  passage  and  words  whooo 
meaning  can  he  inferred  reasonably  well  from  tho  context, 

None  of  the  items  is  answerable  withorrl  readinB  the  pas¬ 
sage.  For  example,  items  to  measure  whether  the  alndeut  under¬ 
stands  the  meaning  of  a  word  used  in  the  passage  are  not 
included  unless  the  distractors  w’ov.ld  be  justifiable  if  the 
words  were  used  in  a  different  context,  (Seo  Saraple  Item  98 
for  an  example  of  this.) 

The  ability  measured  by  tills  Lust  is  cloDoly  related  to 

general  Intelligence  ar.d  as  such  is  a  good  predictor  of  school 

success  in  an  academic  or  liberal  arts  curriculum. 

,1 

In  the  average  secondary  school  aituotion,  most  studcut^ 


who  are  poor  r-vadero  probably  lack  the  basic  inLcllectu'  l 


potential  -to  become  good  readers.  Ttiio  generali nation  nv.- 

A 

l^-'.'adxrig 

Comprehension  Test  but  obtains  good  .'.cor.'..  <j.i  '1,1  V*' 


somewhat  less  applicable  in  inadeciuate  school  situHtio- 
the  unusual  situation  where  a  student  sc'->r  ,  lo’.i  C'h  • 


intellectual  tests,  he  may  have  a  spec!  ■‘'ic  ^oabll 

that  will  reepord  well  to  special  r-nti*.  Un-i  - 


H.  Creati'- 1 < 
. .  —  ^  » 


Purpose  of  test.  The  purpes'-  th-.-  tost  in  co  r.cuuure 

the  ability  to  find  Ingenious  .Ju  .  aoi,-  Oj  a  vari-  .y  o'  prac- 

\ 

tical  problems.  It  is  1,-  to  measure  something  over  and 

above  tests  of  lo^'^  •  ■  reasoning  where  the  problems  are  very 
highly  stru'"  •  ed  and  have  formal  unique  solutions.  There 
is  soTi  idence  that  this  anility  Is  related  to  many  kinds 
of  t'.'i  tivlty, 

^Hlsuorlcsl  antecedents.  Many  ectempts  have  been  meide 
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to  measure  creativity  or  ii^tenuity.  Pexiuivs  tl»  i|io8t  ocn- 
prehensive  effort  in  recent  years  has  been  that  of  Guilford 
(9)  'vriao  studied  the  interrelationa  of  many  tests  of  fluency, 
imagination,  and  originality.  A  recent  develop&ent  is  the 
new  item  type  designed  by  Flanagan  (7)  to  measure  ingenuity 
and  inventive  skiU,  the  ability  to  deVise  ingenio\is  pro¬ 
cedures,  equipment,  or  presentation^.  He  developed  a  new 
response  format  which  avoided  suggesting  the  correct  res¬ 
ponses  to  the  problaa  as  presented.  The.  examinee  is  given 
the  problem  and  a  few  clues  and  is  required  to  devise  an 
ingenious  solution.  Uhls  is  the  type  of  item  used  in  the 
Ingenuity  Test  of  the  Plaujgan  Aptitude  Classification 
Tests  (fact  Batter,/). 

Description  of  Talent  Creativity  Test.  This  test  is 
modeled  on  the  FACT  Ingenuity  Test  described  above. 

Each  Item  canslsts  of  a  complex  problem  similar  to  a 
practical  problem  that  might  be  encountered  in  real  life. 

The  examinee  must  think  of  a  clever  or  ingenious  solution. 

!nie  correct  soluticai  (word  or  phrase)  seems  to  "click"  into 
place,  and  the  examines  has  a  definite  feeling  of  closure  . 
when  he  identifies  the  solution,  ^e  choices  are  given  in 
terms  of  the  first  and  last  letters  of  possible  ri^t 
answers.  This  is  to  Insure  that  the  examinee  really  develops 
the  sol\ition,  and  doesn't  Just  pick  it  out  from  among  five 
alternatives.  Two  sample  items  are  given  below: 

Item  105a.  Abtic  and  cellar  stairways  and  stepladders 
are  oftoi  causes  of  household  acciiients. 

One  method  for  preventing  slipping,  wd 
falling  on  wooden  stairs  or  steps  :1s  to  apply 
a  coat  of  varnish  to  each  step,  and  while  the 
vamlsb  is  still  slickly  sticky,  apply  a 
small  amount  of 

A.  d  -  -  n  to  each  step* 

B.  8  -  -  d  to  each  step*  answer  is  B, 

C.  r  -  -  g  to  each  step*  since  "sand"  is 

D.  g  -  -  n  to  each  step*  solution.) 

E.  r  -  -  t  to  each  8t^> 

Item  105b.  The  sanding  and  smoothing  of  knobs  and  other 

small  round  wooden  objects  is  always  a  pro¬ 
blem  because  flat  sheets  of  sandpaper  do  not 
fit  the  knobs.  The  sandpaper  buckles  and 
tends  to  wrinkle.  One  solution  is  to  cut 
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A,  e  ^  n  d - s  in  the 

sandpaper. 

B*  h - 1  t - sin  the 

sandpaper. 

C.  p  — - -1  s - sin  the 

sandpaper. 

D.  t------nv  —  -  sin  the 

sandpflq;>er. 

fij.  m  — - -hb - sin  the 

sandpaper. 


(Ihe  answer  is  C>  since  "parallel 
slits"  is  the  solution. ) 

Uie  items  are  not  intended,  to  require  detailed  know¬ 
ledge  of  specialized  fields.  Xhey  are  intended  to  provide 
a  measure  of  something  beyond  general  knowledge,  vocabulary, 
and  dedvictive  reasoning  ability.  And  there  is  evidence  that 
they  do.  As  would  be  esgpected  from  an  examination  of  the 
items,  the  Creativity  test  to  some  extent  does  measure 
general  ability  of  the  type  measured  by  intelligence  tests. 
And  it  has  been  shown  to  have  a  moderate  amount  of  overlap 
with  various  kinds  of  reasoning  tests,  including  mechanlced 
reeusonlng.  However,  it  does  have  an  appreciable  amount  of 
"xmique  reliable  variance”;  in  other  words  part  of  what  it 
measures  is  an  ability  not  covered  by  any  other  kinds  of 
verbal  or  reasoning  teste  that  have  been  tried  out  in  con- 
Jxmctlon  with  it. 

Hi^  scores  on  this  test  should  be  interpreted  as  in¬ 
dicating  Inventiveness  or  creative  ingenuity.  Such  scores 
would  indicate  that  the  individual  should  do  well  in  dynamic 
problon-  solving  activities  involving  the  creation  of 
original  solutions  to  challenging,  ccaqplex  proUems. 


\ 
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I.  Mechanlceil  Reasoning 

Purpose  of  test.  The  purpose  of  this  test  Is  to 
measure  ability  to  vlstmllze  commonly  encountered  objects 
and  to  recognize  how  the  operation  of  everyday  physical 
forces  and  principles  (e.g.,  gravltatloni  pressure, 
equilibrium)  eind  basic  kinds  of  mechanisms  (e.g.,  gears, 
ptilleys>  wheels,  springs,  levers)  would  affect  them. 

Tests  like  this  have  sometimes  been  called  measures  of 
"barnyard  physics".  A  kind  of  reasoning  vrtilch  Is  re* 
lated  to  mechanlcsil  aptitude  Is  Involved  In  a  test  of 
this  sort. 

Historical  antecedents.  As  early  as  World  War  I, 
mechanical  ability  was  recognized  as  a  type  of  testable 
ability  separate  from  general  Intelligence,  Early  versions 
of  mechanical  ability  tests  were  constructed  at  that  time. 

A  little  later,  various  combinations  of  manipulative, 
pictorial,  and  verbal  items  were  labelled  as  mecheinlcal 
ability  tests  by  a  nvunber  of  Investigators.  It  was  not 
until  much  later  that  It  was  recognized  that  the  different 
types  of  "mechanical"  items  were  really  measuring  somewhat 
different  mental  factors.  In  19^0  the  Bennett  Mechanical 
Comprehension  Test  (l)  was  developed.  This  was  the  first 
mechanical  reasoning  test  of  the  pictorial  type. 

By  the  end  of  World  War  II  the  broad  area  of  mechanical 
ability  had  been  resolved  into  such  commonly  used  tests  as 
mechauaicsd  information,  electrical  Information,  tool  usage, 
spatled  visualization,  eye*h8Lnd  coordination,  and  pictorial 
mechanical  reasoning.  The  latter.  In  the  form  employed  by 
Bennett,  has  been  the  most  widely  used.  However,  many 
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comprehensive  aptitude  test  batteries  employ  most  or 
all  of  tdiese  types  of  tests.  Despite  the  relatively  hi^ 
correlation  between  scores  on  them,  all  have  proven  to 
yield  some  unique  contribution  toward  predicting  success 
in  mechanical  occupations.  The  kind  of  ability  measured 
by  a  mechanical  reasoning  test  of  the  pictorial  type  is 
only  one  of  the  abilities  requisite  for  success  in  certain 
mechanical  occupations.  This  must  be  recognized  in  inter¬ 
preting  results.  An  engineer,  for  Instance,  may  also  need 
a  higli  degree  of  verbal  and  mathematical  ability. 

There  is  a  wealth  of  evidence  supporting  the  validity 
of  mechanical  reasoning  tests  (4)  for  a  wide  variety  of 
occupations,  such  as  airplane  pilot,  auto  mechanic, 
machinist,  welder,  aircraft  mechanic,  sheet  metal  worker, 
tool  and  die  maker.  Such  tests  have  been  widely  used  by 
the  Armed  Forces,  both  for  initial  selection  and  for 
assignment  to  training.  In  the  very  extensive  validation 
studies  in  the  A^ed  Forces,  tests  of  this  sort  have  almost 
invariably  been  found  to  correlate  substantially  with 
measures  of  success  in  mechEuiical  training  courses.  These 
results  are  confirmed  by  many  similar  studies  in  industry. 

Description  of  Talent  Mechanical  Reasoning  Test.  This 
test  uses  about  the  same  type  of  items  as  were  used  in 
Bennett's  MechaniceJ.  Comprehension  Tests.  Each  item  con¬ 
sists  of  a  drawing,  with  a  multiple  choice  question  concern¬ 
ing  how  the  objects  pictured  behave.  A  saa^e  item  is  shown 
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Item  106,  When  worm  gear  X  la  turned  In  the 
direction  shown.  In  which  direction,  If 
any,  does  gear  Y  turn? 

A.  In  direction  A 

B.  In  direction  B 

C.  First  In  one  direction 
and  then  In  the  other 

D.  It  doesn't  turn 

(ihe  answer  Is  A.) 

In  developing  the  Items  an  effort  was  made  to  make 
them  ansverahle  hy  persons  who  had  not  had  any  specific 
fozml  training  In  physics,  or  esperlenee  in  working  vlth 
motors,  woodworking,  or  other  crafts. 

Knowledge  of  tools  and  kxiovledge  of  electricity  are 
not  measured. 

Ihe  test  measures  the  ability  to  detezmlne,  throu^ 
visualisation  and  reasoning  abill-ty  and  on  the  basis  of 
past  observations  of  cosnaon  mechanical  forces  at  work, 
how  physical  objects  bdiave.  While  a  course  In  physics 
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my  belp  on  many  of  the  itene,  a  yoxmgster  vlth  no  formal 
training  in  physics  can  answer  the  c|,\iestlons  intuitively 
or  through  reasoning  if  he  has  a  bent  towards  activities 
of  a  mechanical  nature.  Nevertheless,  in  Interpreting 
scores  on  this . type  of  test,  past  training  and  esqperlence 
should  be  c^sldered.  The  fact  that  girls,  on  the  average, 
score  considerably  lower  than  boys  is  consistent  with  the 
hypothesis  suggested  above  that  environmental  factors 
(training,  e3q>erience,  etc.)  play  a  significant  role  in 
the  development  of  the  kind  of  ability  measured  by  this 
test.  However,  this  clrc\imstance  does  not  render  the  test 
any  less  useful. 

13a.  Visualization  in  Two  Dimensions 
and 

13b.  Visualization  in  Three  Dimeaisions 

Purpose  of  Tests.  The  general  purpose  of  these  two 
tests  is  to  meas\ire  spatial  visualization. 

Historical  antecedents.  Spatial  visualization  has 
been  measured  by  a  great  many  different  kinds  of  tests- - 
tests  involving  manipulation  (dlagrainnatlcally)  of  flat 
figures  in  two  dimensionail  space,  for  instcmce  rotation  of 
the  figures,  and  tests  involving  manipulation  (dlagrammat- 
ically)  of  three-dimensional  figures  in  three-dimensional 
space,  for  instance.-  folding  of  flat  figures  to  make 
three-dimensional  figures,  unfolding  of  three-dlmKislonal 
figures  to  flatten  them  out  (soaetlmes  called  surface 
developmuit),  rotation  of  solid  figures  such  as  cubes, 
visualization  of  hidden  parts  of  solid  structures,  (as  in 
a  "block- counting  test”  where  the  task  is  to  determine  how 


nuy  euf>lo«l  U-oeks  txm  In  an  Irragolmrljr  shapad  atroetura 
not  all  of  vhloh  la  rlaibla). 

Willa  tba  taska  oallad  for  by  thaia  Tarlooa  typaa  of 
Itaas  dlffar  vldaly,  it  has  baan  foond,  by  aaana  of 
factor  analyals  raaaareh,  that  noat  of  than  aaaaura 
aaaantlally  tha  aaat  kind  of  ability.  (  g  ) 

Thla  abUl-ty  haa  bean  found  to  ba  loTOlTod  In  nany 
oeonpational  apaelaltlaa  of  a  taehnlcal,  aaehanloal,  or 
englnaarlng  natttra»for  Instance,  design  engineer,  carpen¬ 
ter,  aechanleal  draftsiaan,  airplane  pilot.  Taata  of  this 
sort  are  useful  for  selecting  students  vho  are  likely  to 
do  aell  In  shop  courses.  These  tests  are  also  useful  in 
vocational  slttiatlons  vhere  the  Individual  mat  aake  a 
quick  adaptation  to  the  desands  of  certain  aeml«skilled 
Jobs  -  especially  those  Involrlng  the  assesAily  of  Irregu¬ 
larly  shaped  parts,  nachlne  operation,  and  the  packing  of 
objects  of  different  shapes  and  sizes. 

f 

Descrlptioo  of  the  Talent  Visualization  Tests.  It 
was  decided  to  measure  spatial  ability  with  two  separate 
tests  In  the  Talent  battery,  a  two-dlmenslooal  visualiza¬ 
tion  test  and  a  three-dimensional  one,  although  It  was 
eiqpeoted  that  the  resultant  scores  would  turn  out  to  be 
rather  highly  correlated.  Each  of  these  two  testa  will  be 
discussed  In  turn,  after  one  feature  they  have  in  common 
Is  mentlooed.  This  is  the  fact  that  the  diagrams  ware  all 
aada  q;ulta  large,  and  free  of  fine  detail,  so  -^t  azeep- 
tlonal  visual  acuity  would  not  ba  required  to  detaradne 
tha  answer. 

1*  visualization  in  Two  Dimensions.  This  test  Is  of  the 
.  type  that  C8JJ.S  for  distinguishing  between  figures 
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idiich  have  been  "reflected"  and  figures  vhich  have  nerely  been 
rotated  vlthout  reflection,  so  that  they  are  essentially  iden¬ 
tical,  awrely  in  different  positions.  Each  item  consists  of 
a  given  figure  foUoved  by  five  other  figures.  Ihe  task  is 
to  determine  which  one  of  the  five  could  be  twisted  around  to 
coincide  with  the  given  figure,  without  "lifting  it".  (She 
other  four  are  "mirror  images”  and  would  have  to  be  reflected 
as  well  as  rotated.  A  sample  item  follows: 

Item  107. 

k.  X  ^  ^  ^  > 

A  B  C  D  E 

(The  answer  Is  B.) 

2.  Visualization  In  Three  dimensions.  This  test  measures  a- 
bllity  to  visualize  what  a  two-dimensional  figure  would  look 


like  if  it  were  folded  or  rolled  to  form  a  three-dimensional 
figure.  Inthese  items  folds  cure  indicated  by  dotted  lines 
and  cuts  by  interior  solid  lines.  Two  saaple  items,  an  euy 
one  and  a  relatively  hard  one,  are  shown  below. 


Item  108. 


(The  answers  are  E  and  D,  respectively.) 
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l4.  Abstract  Reasoning 

Purpose  of  Test*  This  Is  a  non-varbal  test  of  Induc¬ 
tive  reasoning  ability. 

Historical  antecedents.  One  of  the  najor  purposes 
of  non-verbal  reasoning  tests  originally  vas  to  measure 
the  basic  Intelligence  of  Individuals  vlth  language 
handicaps.  Efforts  along  these  lines  vere  made  even  before 
World  War  I.  It  has  since  been  found,  hovever,  that 

the  kind  of  abstract  reasening  ability  measured  by  non-  > 
verbal  tests  Is  not  the  seune  thing  as  the  kind  of  ability 
measured  by  verbal  Intelligence  tests.  It  Is  this  very 
fact  that  makes  this  kind  of  test  more  generally  useful 
than  It  would  be  If  Its  applicability  vere  limited  to 
persons  with  language  handicaps.  Many  currently  used 
Intelligence  tests  Include  measures  of  abstract  non-verbcG. 
reasoning,  as  do  most  multiple  aptitude  batteries.  There 
are  several  different  types  of  Items  measuring  ability  to 
do  abstract  reasoning  about  dlagramisatlc  material  that 
have  been  vldely  used.  Among  these  types  are  flgnire  analo¬ 
gies  Items,  figure  sequences  Items,  pattern  matrices  Items, 
and  figure  grouping  Items.  The  first  three  of  these  Item 
types  all  consist  of  a  pattern  of  diagrams,  with  one  mlssi^ 
Ing  portion  to  be  selected  from  among  several  options.  In 
the  fourth  Item  type,  figure  grovqplng,  the  task  Is  a  little 
different}  It  Is  to  determine  what  the  :prlneiple  Is  whi<^ 
ties  several  diagrams  together,  and  on  the  basis  of  tMs 
principle  to  determine  which  pattern  from  among  several 
options  belongs  with  the  group  of  patterns.  In  all  of 
these  abstract  reasoning  Item  types,  the  solution  of  the 
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Item  depends  \qpon  the  ability  to  determine  a  logical  rela¬ 
tionship  among  eleiaents  of  the  pattern  and  to  apply  this 
relationship  in  order  to  identify  an  element  that  belongs 
in  the  pattern— either  in  a  specified  position,  as  in  the 
case  of  the  figure  analogies,  figure  sequences,  and 
pattern  matrices  tests,  or,  as  in  the  case  of  the  figure 
grouping  test,  just  some  place  in  the  group.  Sanple 


items  of  each  type  are  shown  below* 
Item  HQ.  (Figure  aswlogy  item). 
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Item  113. 

u  Vlj  ^ 


ACU>0 

ABODE 


(ibe  aasvers  are  D,  D,  and  C  respectively) 
On  the  basis  of  eiq^irlcal  data  there  seems  to  be 
relatively  little  clear  evidence  that  any  of  the  types  of 
Items  discussed  above  Is  markedly  superior  to  the  others. 

Description  of  Talent  Abstract  Reasoning  Test.  It  vas 
decided  to  use  the  pattern  matrices  form  of  Item  In  the 
TAlent  test  because  It  seemed  to  have  the  advantage  of 
somewhat  greater  generality  than  the  other  item  types. 
Essentially  both  figure  analogies  and  figure  sequences  are 
special  cases  of  pattern  matrices.  Almost  any  figure 
analogy  Item  can  be  translated  into  the  pattern  matrices 
format^  using  a  2  z  2  matrix.  For  instance,  figure 
analogy  item  110,  in  the  pattern  matrices  format,  would 
appear  as  shown  In  sample  Item  ll4. 

Item  Ilk. 
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Similarly,  tho  figure  sequence  Item  type  is  readily 
convertible  to  the  pattern  matrices  format.  For  Instuiee, 
consldBr  figure  sequence  Item  111.  Two  pattern  matrices 
versions  of  the  same  Item  are  shown,  as  sample  Items  115 
and  116. 


Same  options 
CIS  Item  111. 


Item  115. 


Item  116. 


Some  options 
as  Item  112. 


(The  answer  Is  D  for  both  items  above  as  for  Item  111.) 


k- 
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Solution  of  abstract  reasoning  Iteu  depenls  oa  ability 
to  determine  Inductively  the  logical  relationship  aaong 
the  elenenta  of  the  pattern,  and^  to  apply  this  relation¬ 
ship  in  order  to  identify  the  missing  element. 

Vhlle  no  claim  can  be  supported  that  a  test  of  this 
type  Is  idiolly  culture-free  It  Is  certainly  pore  '^culture- 
falr"  than  a  test  directly  involving  verbal  ability  would 
probably  be . 

Scores  on  this  type  of  test  are  widely  used  as  a 
measure  of  the  ability  to  do  good  school  work  in  academic 
curricula,  especlsilly  In  the  case  of  individuals  with  lit¬ 
tle  schooling  or  with  cultural  or  environmental  handicaps. 
Individuals  irlth  these  handicaps  \dio  score  low  In  vocabu¬ 
lary  and  reading  but  high  oh  'Uils  test  can  be  regarded  as 
having  a  high  Innate  potential  for  academic  work.  However, 
If  plans  are  being  made  for  advanced  academic  work  low 
scores  on  the  other  tests  cannot  be  dlsxegai^ded,  since  they 
Indicate  that  considerable  remedial  work  should  precede 
advanced  schooling.  Among  the  general  nm  of  students, 
scores  on  the  Abstract  Reasoning  Test  should  be  Interpreted 
as  Just  another  element  In  the  general  domain  of  Intellec¬ 
tual  potential. 
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L.  Arlthmetla  Reasoning  (Matheaatlcs  Jfmrt  I) 

Purpose  of  Test.  This  test  is  designed  to  measure  the 
ability  to  do  the  kind  of  reasoning  required,  to  solve 
wlthmetlc  problems Insofar  as  possible,  arithmetic 
confutation,  except  tne  very  slnflest  level,  Is  excluded 
by  the  derl^  of  the  test. 

Historical  Antecedents.  In  addition  to  their  obvious 
use  for  achievement  tests  In  elementary  school,  lAere  arith¬ 
metic  reasoning  Is  taught,  objective  arithmetic  reasoning 
items  have  frequently^. been  used  in  Intelligence  tests. 

Deacjslntlon  of  .Talent  Arithmetic  Seasoning  Test.  The 
chipf  dlfferencq  between  the  Talent  test  in  arithmetic 
reasoning  and  most  ether  tests  of  this  ability  Is  that  in 
the  Talent-  test  a  systematic  effort  was  made  to  eliminate 
almost  all  confutation,  even  at  an  easy  level.  This  was 
done  in  an  effort  to  reduce  the  correlation  between  scores 

I 

on  this  test  and  scores  on  the  Arithmetic  Confutation  test— 
a  correlation,  idilch  is  usxially  quite  substantial.  <  The  aim 
of  the  Talent  '^st  is  solely  to  determine  ^diether  the 
student  can  do  the  reasoning  pairt  of  a  problem— not  idiether 
he  will  do  the  subsequent  confutation  carefully  enough  to 
avoid  careless  errors,  ncr  >diether  he  knows  the  simple 
number  combinations  (e.g.,  9^7  ■  63).  The  intention  was 
to  measure  these  latter  facts  and  abilities  in  the  Arithme¬ 
tic  Computation  teat  and  to  txy  to  avoid  contaminating 
the  Arithmetic  Reasoning  test  with  them.  Several  devices 
were  used  to  achieve  this  end.  One  Mch  device  was  to 
require  the  student  to  tell  how  he  would  solve  a  stated 


■je 
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problem  but  not  to  require  him  to  actually  do  the  necese* 
ary  oonputatlon.  A  saople  item  le  shown  belov: 

Item  117*  Three  percent  of  a  certain 

number  is  ll^l«  To  find  the 

number,  you  would 

A.  divide  lUl  by  .03 

B.  divide  llH  by  3 

C.  divide  141  by  300 

D.  multiply  l4l  by  .03 

E.  multiply  l4l  by  300 

(The  amswer  is  A.) 

A  partial  list  of  the  types  of  items  used  follows: 

1.  Items  asking  what  process  (e.g.,  addition, 
subtraction,  multiplication,  or  division) 
should  be  used  for  a  given  problem.  (See 
sample  item  117. ) 

2.  Items  which  present  several  facts  and 
then  ask  which  one  is  not  needed  in 
sovling  a  certain  problem. 

3.  Items  ^Ich  present,  several  facts  and 
then  ask  what  additional  information 
woTild  be  needed  to  solve  a  certain  problem. 

4.  Items  which  present  several,  facts  and  then 
uk  which  one  of  several  problems  cannot 
be  solved  on  the  basis  of  the  facts  given. 

No  items  were  included  which  required  algebraic  tech¬ 
niques  for  solution.  However,  no  problem  was  proscribed 
Just  because  it  covild  be  solved  efficiently  by  algebra, 
provided  there  was  an  alternate  way  of  solving  it,  without 
algebra. 

Arithmetic  reasoning  is  perhaps  the  sort  of  test  in 
which  the  relationship  between  aptitude  measures  and 
achievement  measures,  idiich  sometimes  appears  to  be  a  con¬ 
fused  one,  can  best  be  clarified. 

An  arithmetic  reasoning  test  measures  achievement  in 
something  which  has  been  taught,  since  virtually  everyone 
in  our  culture  today  goes  to  school  long  enough  to  be 
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ejgposed  to  arithattlo  probleas  «t  tbe  sixth  and  aarenth 
grada  laral.  But  It  alao  aBaauraa  aptitude— tha  aptitude 
for  more  advanced  nathenatlea  and  the  aptitude  for  naxxy 
klnda  of  Jobai  !Ebe  ability  to  handle  arlthnatlo  reaaonlng 
problana  veil  not  only  la  directly  liqportant  In  nany  Joba 
but  It  haa  been  knovn  to  be  Indicative  of  ability  to 
aucoaad  In  nany  other  klnda  of  Jobs,  that  do  not  Involve 
arithmetic  reasoning  tasks  and  have  no  apparent  dlzect 
connection  with  aathematlcs. 

l6a.  Mathematics  Part  II  (introductory) 
and 

l6b.  Msthematles  Part  III  (Advanced) 

Purpose  of  Test*  The  purpose  of  these  two  subtests 
Is  to  measure  achievement  In  all  kinds  of  mathematics 
taught  In  high  school  (or  earlier)  with  the  exception  of 
the  areas  covered  In  the  Arithmetic  Computation  test  and 
In  Mathematics  Fart  I  (Arithmetic  Reasoning). 

Part  II  (introductory  Mathematics)  covers  topics 
normally  taught  in  Grade  9  or  earlier.  Fart  II  (Advance^d 
Mathematics)  covers  topics  nomally  taught  in  Grades  10-12 
in  college  preparatory  courses. 

Historical  Antecedents.  Test  In  college  preparatory 
mathematics,  such  as  algebra,  geometry,  or  trlgnometry, 
are  In  most  situations  more  appropriately  regarded  as 
measures  of  achievement  than  of  aptitude,  since  amount  of 
exposure  to  this  type  of  subject  matter  Is  hl|#ily  variable, 
in  contrast  vlth  arithmetic  reasoning  problees,  to  which 
virtually  everyone  Is  es^sed  In  eleantary  school. 

Within  groups  where  more  advanced  mathematics  Is  taken  by 
everyone,  for  Instance  In  schools  >diere  It  Is  a  required 
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subject,  asthenaitics  achievement  measures  may  be  used  to 
Indicate  basic  potential  for  that  soart  of  mental  process. 

But  advanced  nathematics  in  high  school  is  far  more 
likely  to  be  an  elective  than  a  required  subject.  Thus 
these  tvD  subtests  are  to  be  regarded  primarily  as  achieve¬ 
ment  tests.  Although  there  is  little  precedent  for  includ¬ 
ing  such  tests  in  vhat  may  be  regarded  as  primarily  a 
predictive  battery  rather  than  an  achievement  battery,  they 
should  serve  a  useful  purpose,  paortlcularly  since  achieve¬ 
ment  in  mathematics  has  been  found  to  be  quite  closely 
related  to  success  in  many  kinds  of  college  curricula. 

Description  of  Talent  test.  The  items  are  Intended 
prlmeorily  to  test  \inderstandlng  of  basic  concepts  and 
methods,  rather  than  rote  memory.  Little  enphasls  is 
placed  on  facts  and  definitions  since  this  domain  is 
covered  in  the  Mathematics  scale  of  the  Information  Test. 

In  interpreting  results  it  should  be  borne  in  mind 
that  the  distinction  betveen  topics  taught  in  Grade  9  and 
earlier  and  those  taught  later  than  Grade  9  is  not  a  cleau* 
one  since  curricula  in  different  schools  differ. 

1.  Panrb  II  (Introductory) 

The  primary  en^hasls  of  this  subtest  is  on 
ninth  grade  elementary  algebra,  but  other  topics 
include  some  taught  in  elementary  and  Junior  high 
school,  such  as  fractions,  percentage,  intuitive 
geometry,  elementary  measurement  formulas  (area  of 
triangle,  circumference  of  circle,  etc.),  square 
root. 

Actual  computation  is  kept  to  an  absolute  mini¬ 


mum. 
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Two  saople  Itena  follow. 

Iton  116.  Th«  area  of  a  rectangle  s 
Inches  vide  is  three  tines  the  area 
of  a  square  with  a  side  s  Inches 
long.  The  length  of  the^rectangle 

is 

A.  s^ 

3 

B.  3b 

2 

C.  38 

D.  8 

3 

B.  sVb 

Item  119.  Vniat  Is  the  first  digit  of 
tM  square  root  of  485726?  (Sint; 

Bo  not  congpute  the  square  root. ) 

A.  1  _ 

B.  2 

C.  4 

B.  6 

E.  7 

(The  answers  are  B  and  B  respectively. ) 

2.  Part  m  (Ad»i>need) 

Though  these  items  may  be  regarded  as 
"achievement"  items,  they  are  not  designed  to 
measure  achievement  In  any  specific  course.  There¬ 
fore  an  effort  was  made  to  limit  the  items  in  this 
subtest  to  ones  of  such  a  nature  that  if  consider¬ 
able  time  had  elapsed  since  the  student  studied 
the  material,  and  if  he  had  conseq'oently  forgotten 
it,  ho  would  be  able  to  reconstruct  it  fairly 
rapidly,  through  logical  analysis,  provided  he 
really  understood  it  thoroughly  in  the  first  place. 
Thus  for  Instance  in  measuring  achievement  In 
advanced  algebra,  iteme  oi  how  to  solve  a  cubic  or 
quartie  equation  would  certainly  not  be  Included. 
Remembering  these  procedures  would  require 
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menorlzatlon  of  conpllcated  foroulss,  and  If  thase 
had  been  forgotten  they  could  not  be  reconstructed 
Instantaneouslyi  even  by  someone  good  at  mathe¬ 
matics*  On  the  other  hand,  items  reijulrlng  the 
student  to  use  the  principle  that  the  probability 
of  two  Independent  events  Is  the  product  of  their 
Individual  probabilities  would  be  acceptable. 

Even  if  the  student  hasn't  memorized  the  theorem, 

It  should  be  quite  obvious  to  him  If  he  understands 

the  concept  of  probability.  _ 

HIM  Items  san^le  a  vide  range  of  concepts 
covered  in  the  last  three  years  of  hl^  school 
mathematics.  The  concepts  are  not  limited  to 
those  tavight  in  all  high  schools  offering  four 
years  of  mathematics.  Among  the  areas  Included 
are  plane  geometry,  solid  geomstry,  algebra 
(quadratic  equations  and  beyond),  trigonometry, 
elements  of  analytic  geomstry,  and  intro¬ 
ductory  calculus.  Sample  Items  follow. 

Item  120.  If  10®»  r*^,  the  value  of 

logj^^r  Is 

A.  4m 

B.  m**^ 

C.  4™- 
m 

D. 

E. 

Item  121.  Ifa<b<o<e  and  d  >  b, 

it  follows  that 

A.  d  <  c 

B.  a  >  d 

C.  d  >  a 

D.  c  <  d 

E.  d  <  e 


VII-94 


Item  122»  A  ratio  vhloh  Is  alvays  the 
sane  Is  the  ratio  of  a  circle's 

A*  area  to  Its  circumference^ 

B.  radius  to  Its  area. 

C*  clrciunference  to  ^ . 

D.  diameter  to 

E*  radius  to  Its  circumference. 

(The  ansvers  are  D,  C,  and  E  respectively.) 

This  subtest  Is  intended  primarily  to  provide 
a  national  Inventory  of  students  ^o  have  cached 
specified  levels  of  achievement  in  mathematics. 

As  vlth  tht-Other  tests,  norms  were  obtained 
for  each  grade  separately.  Thus  there  is  a  suit¬ 
able  base  for  interpretation  of  9th  grade  results, 
taking  Into  consideration  the  fact  that  most  of 
the  9th  graders  will  not  have  had  formal  Instruc¬ 
tion  on  the  topics  covered. 

17*  Arithmetic  Computation 

PoiDOse  of  Test.  The  purpose  of  the  test  Is  to 
measure  speed  and  accuracy  of  basic  coniputation  operations 
(addition,  subtraction,  multiplication,  and  division)  with 
whole  numbers. 

Historical  antecedents.  Arithmetic  con^tatlon  tests 
can  vary  in  several  dimensions,  including: 

1.  Whether  the  operations  are  limited  to  ^ole 
numbers  or  whether  fractions  and  decimals  ao:« 
Included. 

2.  Whether  the  problems  are  limited  to  those  that 
can  readily  be  dme  mnitally  (e.g.,  operations 
with  one-dlglt  nuaftwrs)  or  whether  they  ore  more 


difficult  than  that 


3>  Whether  the  kinds  of  operations  are  limited  to 
the  four  basic  ones  or  whether  more  difficult 
operatimsj  such  as  square  roots,  are  Included. 

4.  The  generosity  of  the  time  allowance. 

When  arithmetic  confutation  tests  are  Intended  pri¬ 
marily  as  school  achievement  measxires,  the  chief  concern  is 
usTially  accuracy  and  knowledge  of  methods,  irather  than 
speed.  For  such  purposes,  therefore,  it  is  advantageous 
for  the  test  to  cover  a  coinparatively  broad  variety  of 
operations,  to  Include  some  problems~that  are  Ixmately 
qulte  difficult,  and  to  have  a  liberal  time  allowance. 

It  has  been  found,  however,  that  when  am  arithmetic 
computation  test  is  primarily  intended  to  serve  as  a  Job 
aptitude  meastire,  the  most  useful  results  are  obtained  if 
the  number  of  items  is  large  and  the  time  limit  so  short 
that  nobody  can  finish,  and  if  the  items  themselves  are 
Innately  quite  eamy,  so  that  if  errors  aure  made  they  aure 
likely  to  be  due  to  carelessness  rather  than  to  Ignoramce. 
When  the  test  is  set  up  this  way,  most  of  those  tested  get 
the  right  answers  to  a  fairly  high  proportion  of  the  items 
they  reach.  An  arithzaetlc  confutation  test  of  this  type  is 
Included  in  most  multiple  aptitude  batteries. 

The  ability  measured  by  an  aptitude  test  of  this  sort 
has  been  found  Infortant  in  many  kinds  of  occvrpatlons  that 
involve  quantitative  work- -for  instance^  accountant,  bank 
teller,  business  manager,  machinist,  booklraeper,  auditor. 

Scores  on  this  type  of  test  do  not  have  a  particularly 
high  correlation  with  scores  on  arithmetic  reasoxing,  or 
other  mathematics  tests.  A  student  nay  do  well  in  mathe¬ 
matics  in  high  school  and  college  even  if  he  is  not 


outstandingly  Hast  and  accurate  In  sliqple  arlthmstlc  com¬ 
putations. 

Description  of  T^ent  Arlthmstlc  Computation  Test. 
Operations  tirith  both  single-digit  and  nultl-dlglt  numbers 
are  Included.  The  four  basic  types  of  items  are  cycled 
(addition,  subtraction,  multiplication,  division, 

addition . ).  The  division  items  all  call  for  short 

division  (no  divisors  greater  than  12). 

The  operations  tested  are  limited  to  relatively  single 
ones.  Consnitation  of  square  roots  is  not  tested,  nor  is 
congiutatlon  involving  decimals,  fractions,  or  percents. 
(These  kinds  of  operatlois  were  omitted  because  ability  on 
them  has  been  found  to  be  more  closely  related  psycho- 
metrlcally  to  arithmetic  reasoning  and  more  advanced 
mathematics  than  to  sisple  con^tatlon. )  Sanple  items  atre 
shown  below. 


Item  123.  Add: 


k23 

33 


Item  12k’ .  Subtract ; 

k03 

zH 


A.  472 

B.  475 

C.  4b5 

D.  575 

E.  5tt5 


A.  340 

B.  366 

C.  376 

D.  377 

E.  476 


Item  125.  Multiply: 

206 

Item  126.  Divide: 

3402  ^  6  - 


The  answers  are  C,  B,  C, 


A.  1624 

B.  16024 

C.  19364 

D.  19^ 

E.  19564 


The  students  are  Instructed  to  do  their  scratchwoi^k 
In  the  test  booklets,  so  that  they  do  not  have  to  copy  the 
problems  first.  (This  eliminates  the  effects  that  variable 
clerical  speed  and  accvtracy  vould  have  on  the  eonpvitation 
scores.) 

Three  scores  are  obtained  for  each  studmxt:  number 
right  (R),  number  attempted  (a),  and  the  cos^slte  (4'R-3A). 
(Enpirlcal  evidence  will  eventually  be  obtained  aS'  to 
whether  another  fomola  might  give  better  results  .  for  some 
purposes . ) 

The  score  given  by  the  formula  above  (4r-3A)  is 
designed  to  give  an  indication  of  the  student's  ability  to 
perform  slsple  cospitatlons  accurately  and  at  a  high  speed. 

18.  Table  Reading 

Purpose  of  test.  The  purpose  of  this  test  Is  to 
measure  speed  and  accuracy  of  perception  in  a  non-conputa)^ 
tlonal  clerical  task,  involving  obtaining  Information  from 
tables.  This  kind  of  clerical  aptitude  Is  more  cosplex  than 
that  measxired  by  clerical  checking  tests. 

Historical  Antecedents.  This  type  of  test  was  devel¬ 
oped  during  World  War  II,  in  the  Air  Force  Aviation 
Psychology  Program,  as  a  "Job  sanple"  test  for  selecting 
navigators.  The  test  was  later  found  to  be  useful  in  pre¬ 
dicting  success  In  a  vide  variety  of  occt^tlonal  activities, 
some  of  them  not  directly  concerned  with  table  reading  at 
aU.  Table  reading  tests  differ  considerably  In  terms  of 
the  cosplexlty  of  the  task  called  for. 

Among  the  kinds  of  Jobs  for  which  table  reading  tests 
are  useful  predictors  are  clerk- typist,  draftsman,  secre¬ 
tary,  accountant,  bookkeeper,  statistician,  statistical 
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clerk,  shipping  clerk,  zutTlgetor.  Of  coarse  the.  test  is 
relevant  to  only  one  aspect  of  these  Jobs  sad  therefo»  a 
high  score  on  It  does  not  goarantee  success  In  the  Job, 
since  other  aptitudes  and  abilities  are  also  involved. 

Description  of  the  Talent  Table  Beading  Test*  This 
test  consists  of  a  table  with  Instructions  as  to  hov  to  use 
it,  together  vlth  a  ntmiber  of  nultiple  choice  items  that 
have  to  be  answered  by  reading  the  table.  The  time  allov> 
ance  is  very  brief,  to  insure  that  nobody  has  time  to 
finish. 

Three  scores  are  obtained  for  each  student:  number 
right  (R),  number  attespted  (a),  and  the  coaposlte  (2R-A). 

The  task  called  for  by  this  test,  while  not  particu¬ 
larly  hard,  is  sufficiently  coaplex  that  slow  learners  may 
have  a  little  difficulty  figuring  out  what  to  do  and  how 
to  go  about  it. 

19.  Clerical  Checking 

Purpose  of  Test.  This  test  is  designed  to  measure 
speed  and  Mcuracy  of  perception  in  a  very  sinple  clerical 
task  involving  working  with  verbal  naterlals  (names). 

Historical  Antecedents.  Tests  of  this  sort  usually 
consist  of  pairs  of  names,  numbers,  groups  of  letters,  or 
combinations;  the  subject  is  to  indicate  whether  the  two 
elements  of  the  pair  are  exactly  the  same  or  different. 

These  tests  always  have  a  very  short  time  limit,  so  that  no 
(me  will  have  time  to  finish.  Ordinarily  a  very  large 
nuaher  of  items  can  be  vozked  in  a  very  short  period  of 
time. 

These  tests  measure  one  of  the  very  inportant  aptitudes 
involved  in  clerical  work.  Tests  of  this  sort  have  been 
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found  relevant  to  success  not  only  in  a  vide  variety 
of  clerical  jobs  but  also  In  many  other  jobs  which  are 
essentially  non-olerleal  In  nature  but  which  hare  e  sub^ 
stantlal  eomiponent  requiring  this  type  of  accuracy;  for 
Instance  accountants . 

A  test  of  this  type>  on  which  the  Talent  C!lerleal 
Cheeking  Test  Is  modeled.  Is  an  Ispoirtant  part  of  the 
IMlted  States  Ecployment  Service's  General  Aptitude  Test 
Battery. 

Description  of  Talent  Clerical  Checking  Test.  This 
test  consists  of  pairs  of  names.  The  task  is  to  coiig>are 
the  two  names  and  mark  S  if  they  are  exactly  the  same  and 
D  If  they  are  different. 

Belov  are  three  sasple  Items: 

Joe  Abernathy  Joe  Abemethy 

Charles  Q.  PUtdown  Charles  Q.  PUtdown 

Mary  Ann  Wllsson  Marianne  WUsson 

(The  euaswers  are  D,  S,  and  D  respectively. ) 

Three  scores  are  obtained  for  each  student:  nuaiber 
right  (r),  number  attespted  (a),  and  the  conposlte  '(UR-3A). 

20.  Object  Inspection 

Purpose  of  the  Test.  The  purpose  of  this  test  Is  to 
measure  speed  and  accuracy  of  perception  of  form.  More 
specifically,  It  Is  Intended  to  measure  the  ability  to 
spot  laperfectlons  In  small  objects  quickly  and  accurately, 

when  comparing  them  visually  vlth  a  standard. 

* 

Historical  Antecedents.  The  type  of  ability  measured 
by  this  test  is  useful  in  occupations  where  inspection  is 
one  of  the  Job  elements.  It  has  been  found  to  be  ia|N>rtaat 
In  many  assembly»llne  Jobs.  It  also  has  been  found  to  play 
a  part  In  some  conplex  engineering  activities  where 
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Inspection  of  detail  le  an  Inqportaat  eleaent.  \ 

Peeerlptlon  of  ttULent  0b.1ect  Iheneetlon  Teet*  E^'sh 
problaa  conslets  of  pictures  of  five  sinall  objects,  four 
of  nbleb  are  supposed  to  be  Identical*  !Ihe  reaalnlng  one 
Is  sUgbtly  different.  Hhe  task  Is  to  pick  out  the  picture 
that  Is  different. 

A  sesqple  Item  foUovs. 

Item  130. 

ABODE 
{•She  answer  Is  D.) 

tUhree  scores  are  obtained  for  eeu:h  student:  number 
rle^t  (R),  number  atteog^ted  (A),  and  the  con^slte  (2R-A). 

21.  Ihe  Preferences  Test 

Purpose  of  test.  Ihls  test  has  potentialities  for 
being  used  In  mangr  vays.  One  poslblUty  Is  that  since  It 
vas  given  with  an  extremely  stringent  time  limit,  the  num¬ 
ber  of  problems  on  which  the  student  has  time  to  make  his 
decision  (l.e.,  to  ejqpress  a  preference)  will  Indicate  his 
speed  In  making  at  least  one  sort  of  decision. 

It  Is  also  ejqpected  that  some  eagplrlcal  keys  can  be 
set  up,  wlileh  any  be  useful  in  other  ways. 

Hatorioal  Antecedents.  Qm  prefermees  test  la  one  of 
liioae  ttet  ana  put  In  tbe  bnttezy  for  ekparlawtal  purpoaao 
rathMT  timn  boeause  there  are  any  elear  aateoedMits  uhleh 
suggest  that  a  test  of  this  sort  would  be  useful. 

Description  of  TIalent  Preferences  fast.  Each  item 
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consists  of  a  pair  of  adjectives  vhlch  night  describe  a 
person.  The  student  is  required  to  pick  the  adjective  from 
each  pair  that  he  vould  rather  have  applicable  to  his 
friends. 

The  two  characteristics  paired  are  Intended  to  be 
about  equal  In  social  acceptability,  at  least  for  an 
average  group. 

The  Preferences  Test  Is  not  Intended  to  be  a  test  of 
vocabulary.  An  effort  was  nade  to  limit  the  adjectives  to 
those  that  nost  higa.  school  students  vould  tmderstand*  FOr 
this  reason  some  highly  colloquial  terns  were  used  (e.g., 
"smart-aleck",  "stuck-up"). 

In  considering  the  results  derived  from  this  test  It 
Is  Important  to  bear  In  mind  that  THE  TEST  IS  EXPERIMENTAL. 
As  yet  nobody  can  be  sure  idiat  It  measures. 

In  regard  to  Its  relation  to  "decision-making".  It 
must  be  remembered  that  only  one,  very  limited,  kind  of 
decision-making  Is  Involved.  While  It  Is  hoped  that  the 
measured  trait  will  prove  somewhat  generallzable.  It  Is 
recognized  that  this  may  not  be  the  case,  or  that  the 
trait  nay  be  generallzable  to  only  a  very  limited  extent. 

It  is  plaxined  to  investigate  the  hypothesis  that  at  least 
under  some  circumstances,  the  test  locates  the  Individual 
on  a  continuum  that  has  "snap- Judgments"  at  one  end  and 
"indecision"  at  the  other. 

22.  ThwBBS 

The  two  five-minute  themes,  described  in  Oiapter  k, 
have  been  Inclxided  In  tlM  battery  for  the  Allowing  three 


reasons : 
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1.  They  will  provide  eone  Ineight  Into  the  student's 
values,  attitudes,  personality,  motivations,  and 
plans.  (This  Is  discussed  In  Chapter  XI.) 

2.  They  vUl  provide  a  basis  for  determining  vhether 
the  student  can  write  coherent  and  connect 
Ehgllsh— free  of  mechanical  errors  (spelling, 
punctuation,  grannar,  etc.),  well  e:)q>res8ed, 

and  logically  org£uaized.  It  is  fully  lecognized, 
however,  that  themes  as  brief  as  these  provide 
only  limited  scope  for  demonstrating  the  ability 
to  produce  a  well  organized  conpositlon. 

3«  In  addition  to  their  inherent  value  aus  Indices 
of  the  ability  to  write  effective  Ehgllsh,  they 
can  be  scored  to  provide  an  independent  criterion 
of  this  ability,  against  which  the  relevant 
English  subscores (primarily  the  Effective  Exprea- 
sion  score)  can  be  validated*. 


*To  validate  a  test  means  to  determine  the  degree  to 
which  It  measures  what  it  Is  Intended  to  measure  or 
predicts  what  It  is  Intended  to  predict.  The  usual 
method  of  vc4idatlon  Is  to  correlate  the  test  with  an 
appropriate  independent  criterion. 


Table  VII-1  Distribution  of  Information  Test 

Number  of  Items 


General 


Part 

I* 

Vocab.  Other  Total 

1. 

Screening 

- 

12 

12 

2. 

Vocabulary 

21 

- 

21 

3. 

Literatxire 

- 

24 

24 

k. 

Music 

- 

13 

13 

5. 

Social  Studies 

- 

24 

24 

6. 

Mathematics 

- 

23 

23 

7. 

Physical  Science 

- 

18 

18 

8. 

Biological  Science 

- 

11 

11 

9. 

Scientific  Attitude 

- 

10 

10 

10. 

Aeronautics  and  Space 

- 

10 

10 

11. 

Electricity  and  Electronics 

- 

20 

20 

12. 

Mechanics 

- 

19 

19 

A.  Tools,  construction 

- 

(10) 

(10) 

B.  Motors  and  mechanisms 

- 

(9) 

(9) 

13. 

Farming 

- 

12 

12 

A.  Farm 

- 

(8) 

(8) 

B.  Ranch 

- 

(4) 

w 

14. 

Home  Economics 

- 

21 

21 

A.  Cooking 

- 

(11) 

(11) 

B.  Other 

- 

(10) 

(10) 

15. 

Sports 

- 

14 

l4 

Subtotal 

21 

231 

252 

Part 

II* 

16. 

Art 

1 

U 

12 

IT. 

Lav 

1 

8 

9 

18. 

Medicine 

1 

8 

9 

19. 

Engineering 

- 

6 

6 

20. 

Architecture 

- 

6 

6 

21. 

Journalism 

1 

2 

3 

22. 

Foreign  travel 

- 

5 

5 

23. 

Military 

- 

7 

7 

24. 

Accounting,  business,  sales 

2 

8 

10 

25. 

Practical  knowledge 

- 

4 

4 

26. 

Clerical 

- 

3 

3 

27. 

Bible 

- 

15 

15 

28. 

Colors 

- 

3 

3 

29. 

Etiquette 

- 

2 

2 

30. 

Hunting 

- 

5 

5 

31. 

Fishing 

- 

5 

5 

32. 

Outdoor  activities  (other) 

1 

8 

9 

33. 

Photography 

- 

3 

3 

34. 

Games  (sedentary) 

- 

5 

5 

35. 

Theater 

- 

6 

6 

36. 

Ballet 

1 

1 

2 

37. 

Foods 

- 

4 

4 

38. 

Miscellaneous 

1 

9 

10 

Subtotal 

9 

134 

143 

TOTAL 

30 

365 

395 

*  Fifteen  subscores  and  a  total  score  were 

obtained 

on  Part 

On  Part  II  individual  responses  to 

each 

item  were 

recorded 

cards. 
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CHAPTER  vni 

THE  BACKBROUND  AND  DESCRIPTION  OP  THE 
STUDENT  ACTIVITIES  INVENTORY,  THE  INTEREST 
INVENTORY,  AND  THE  STUDENT  INFORMATION  BLANK 

Part  !♦  The  Student  ActlvltleB  Inventory 

Early  Considerations  of  the  Test. 

The  Testing  Panel  at  its  meetings  in  May  1958,  strongly 
recommended  that  a  test  of  the  "personality  type"  he  Included 
in  the  Talent  battery  of  tests.  It  has  been  found  repeatedly 
in  many  studies  of  talent  and  its  utilization  that  personality 
factors  are  frequently  an  important  reason  why  some  persons 
fail  to  live  up  to  their  eeurly  promise.  Panel  members  urged 
that  self-report  materials  (those  where  the  student  emswers 
questions  about  himself)  be  collected,  supplemented  by  other 
material  such  as  ratings  by  fellow  students  and  by  the  teach¬ 
ing  stsiff.  The  tremendous  administrative  difficulties  in¬ 
volved  In  collecting  such  sugppleBientary  Infoxmatlon  were  re¬ 
cognized,  however,  euad  the  Panel's  final  reccnmendatlon  covered 
only  the  use. of  a  self-report  inventory.  As  to  the  exact  pro¬ 
cedures  to  be  followed,  the  Panel  did  not  offer  specific  guid¬ 


ance. 
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Hletorlcal  Background  of  Personality  Te»tlng 

Personality  assessment  probably  dates  back  to  the  ear¬ 
liest  history  of  inan>  when  one  caveman  estimated  that  he 
couM billy  another  out  of  the  last  piece  of  maaisoth  meat. 

From  that  time  to  this,  men  have  been  trying  to  describe  and 
predict  the  behavior  of  Other  men,  for  one  purpose  or  another. 
The  neict  fev  pages  present  an  overview  of  the  development  of 
personality  assessment,  with  emphasis  on  the  t^pe  of  person¬ 
ality  assessment  employed  in  Project  Talent. 

Definitions  of  Personality 

Personality  has  been  veurlously  defined;  Allport  (19374 
Ch.  2)  has  presented  a  very  Interesting  discussion,  in  which 
the  word  is  carried  back  to  the  Latin  nersbnna  axid  traced 
through  to  present  day  English,  giving  a  full  30  definitions 
in  the  process.  However,  a  definition  advanced  by  Woodworth 
(1929,  p<333)  appears  appropriate  to  the  survey  nature  of 
Project  Talent  and  served  to  guide  the  development  of  Im¬ 
personality  test: 

"Personality  refers  not  to  any  particular  sort  of  activ¬ 
ity  such  as  talking,  remembering,  thinking  or  loving,  but 
an  individual  can  reveal  his  personality  in  the  way  he  does 
any  of  these  things." 

Early  Beginnings  in  Personality  Assessnent 

Alfred  Binet.  One  of  the  earlier  efforts  to  assess 
personality  as  such  was  made  around  the  turn  of  the  last 
century  by  Alfred  Binet,  whOM  inventive  thinking  resulted 
in  the  now  fsaous  Stanford-Blnet  latelUitnee  tests. 

Blast  (1903)  describes  one  attenpt  to  eategorise  psy¬ 
chological  types  by  means  of  tests.  The  subjects  of  the 
experiment  were  his  two  daughters.  The  most  Important  aspect 
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of  the  experiment  consisted  of  asking  his  daughters  to  vrlte 
lists  of  twenty  words  each.  He  then  asked  them  to  e^g^laln 
the  meaning  of  each  word  and  also  the  Images  that  occured  to 
them  In  connection  with  each  word.  Binet  felt  that  this 
last  step  was  liig>ortant  since  scmietimeB  an  abstract  word  Is 
used  In  a  paz^icular  way  (e.g.  **home"  meaning  !*my  boiBe")i 
and  s(XDetlmea  a  specific  word  Is  used  when  an  abstraction 
is  meant. 

When  Binet  analyzed  the  responses  of  his  daughters  he 
found  Azmande  to  be  Introverted  and  detached  from  reality, 
her  Images  were  vague  and  less  precise  than  those  of  Margue¬ 
rite.  Marguerite's  images  were  concise  and  vivid;  Binet 
found  her  extroverted  cmd  practical. 

In  reaching  these  conclusions  about  hi  a  two  daughters, 
Binet  sorted  the  words  they  wrote  Into  six  categories:  un¬ 
explained  words,  words  naming  ob;}ects  Which  wesre  present  at 
the  time,  words  referring  to  the  person  herself,  words  drawn 
from  memories,  words  representing  abstractions,  and  words 
taken  from  Imagination.  He  noted  that  Armande^s  unexplained 
words  (those:. for  which  she  could  give  no  reason  as  to  why 
she  gave  the  word)  were  more  numerous  than  those  of  Margue¬ 
rite,  yet  much  less  common.  For  example:  messenger,  charac¬ 
ter,  professions,  person;  compared  to:  table,  horse,  plate, 
spoon,  etc.  Marguerite  was  classified  by  Binet  as  an  "obser¬ 
ver”  type  since  she  continually  seemed  to  draw  Ideas  for  new 
words  to  write  by  looking  at  things  around  her .  Marguerite 
named  many  things  which  belcmged  to  her,  Azmande  listed  ixxm  . 
Binet  felt  that  Marguerite  was  In  /act  much  more  concerned 
with  axid  attached  to  her  possessions  than  Armande. 

In  the  case  of  abstractions,  the  two  girls  differed 
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considerably.  Blnet  gives  the  exaaqple  of  listing  the  articles 
contained  in  a  house  saying:  Marguerite  visits  a  particular 
house  mentally  aol  names  the  objects  by  memory;  Amanda  >  on 
the  contrary,  thinks  of  a^  house  and  nasies  the  things  that 
she  knovs  exist  In  any  house.  Further,  Marguerite  produced 
no  Images  \dilch  Blnet  could  classify  as  Imaginative  (vhlch 
he  defined  as  detailed  but  non-existent),  mUxLIa  Armande  gave 
many.  For  exasq;>le.  In  response  to  the  vords  "road"  and  "sun** 

I 

she  described  an  Imaginary  road  running  beneath  a  burning  sim, 
throvtl^  an  open  field  vlth  no  shadovs . 

Based  on  these  experiments,  Blnet  sou|{bt— but  failed  to 
f Ind'-a^ruUng  factor”  or  one-vord  description  vhlch  vould 
cover  the  total  personality  plctinre  of  each  subject,  as  re¬ 
vealed  by  analysis  of  her  responses. 

The  results  of  these  eiq^rlments  left  Blnet  dissatisfied, 
partlcvdarly  vlth  his  failure  to  be  able  to  sun  up  the  total 
personality  picture  in  terns  of  one  domlneuit  aspect  of  it. 
ThuSj  sons  of  the  first  atteoqpts  to  assess  persoiUkLl-ty  scienti¬ 
fically  only  succeeded  In  empbaslalng  Its  diversity. 

Carl  Jungt  Carl  Jung  devised  his  vord  association  technique 
about  :|.906.  This  technique  vas  oriented  more  tovard  person¬ 
ality  assesanent  In  abnormal  people,  thou^  It  supposedly 
applied  to  normals  as  veil.  In  this  technlqim,  the  subject 
vas  Instructed  by  ^  examiner  to  respond  quickly  and  vlthout 
reservation,  to  each  of  a  series  of  100  vords,  giving  the 
first  vord  entering  his  mind  in  response  to  the  stimulus 
vord.  k  modified  Ingllsh  trenslatioB  of  Hds  list  may  ^ 
found  In  Jhng  V*  vli).  In  Um  stendard  series  of  100 

vorda,  a  nuDd>er  of  potentially  smotlonal  vorda  (e.g.  "love”) 
vere  scattered  among  banal  vords  (e.g.  ”box”).  The  examiner 
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noted  each  of  the  subject's  responses,  the  apouht  of  tijne 
elapsed  between  stimulus  and  responsef^  and  such  behaviors 

as  hesitation,  anbarrassment,  and  the  giving  of  the  antonyms. 

I 

i^erences  were  then  drawn  concemihg  his  personality. 

As  might  be  eiqpected  most  of  the  associations  given  to 
such  words  were  relatively  Innocent  of  psychologlced  mean¬ 
ing.  For  exsB^le,  responses  such  as  '*^llght— dark",  "door- 
open",  and  "tooth— ache"  were  of  little  in^rtance  by  them¬ 
selves  In  Judging  personality.  Slmllarlly,  many  responses 
were  of  the  synonym  or  rhyme  types  as  "splendid— magnifi¬ 
cent",  "heaxt — pajrt",  etc.  On  the  other  hand.  Judgments  of 
value  seemed  to  offer  importeuat  areas  for  interpretation, 

^•g.. ,  "father— good",  "ride— dangerous" ,  euad  "small — un¬ 
pleasant".  Jung  (1919)  devoted  considerable  time  to  the 
statement  and  e:q)lanation  of  a  detailed  classification  sys¬ 
tem  of  tyi)es  of  associative  responses  which  Is  much  too  In¬ 
volved  to  describe  here. 

In  hls  interpretations,  Jung  tabulated  the  number  of 
each  of  the  various  kinds  of  responses  given  by  hls  subject, 
using  the  classification  system.  Although  he  believed  that 
even  the  most  objective  euid  trivial  of  associations  had  In¬ 
ner  meaning,  these  were  often  much  too  obscure  to  evaluate. 
Thus,,  he  concentrated  on  those  associations  having  personal 
meanings.  Some  of  these  were  unimportant,  but  taken  to¬ 
gether  provided  some  Insight  Into  areas  with  which  the  subject 

Is  concerned.  For  «cample,  the  responses  "schoolboy— sol- 

"fhltbful— soldier", 

dler",/aQd  "rank— file"  fOxm  a  grovg^  which  tends  to  suggest 
the  svibject's  concern  with  mllitaiy  service. 

While  this  foxm  of  personality  assessment  found  some 
favor  particuletrly  with  the  clinical  and  psychoanalytic 
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gzx>upB  It  required  the  Individual  attention  of  a  highly 
trained  person.  Furtheimore,  relatively  little  vas  done  in 
the  way  of  objective  validation  of  this  procedure,  though 
it  became  quite  widely  used. 

.  Approaches  to  Personality  Assfcssment 
Arising  out  of  the  eeurly  beginnings  discussed  abCve 
and  from  the  Interest  generated^by  the  growing  success  of 
mental  testing,  many  approaches  to  the  assessment  of  per> 
sonallty  evolved.  Some  Idea  of  their  variety  can  be  had 
from  those  discussed  by  Allport  (l937>  Ch.  l4),  which  are 
list^  In  Table  VIII-l. 

Taible  VUI-I 

Approaches  to  Personality  Assessment  (Allport) 


Studies  of  Cultural  Settings 
Physical  records 
Social  records 
Persons!  records 
Expressive  movement 
Ratings 

Standardized  tests 


Statistical  suialyses 

Miniature  life-situations 

Laboratory  experiments 

Prediction 

Dept h-analy s 1 s 

Ideal  types 

Synthetic  methods 


One  approach  not  speciflcelly  mentioned  above  is  Im- 
portemt.  Rorschawh  (1921)  presented  his  Ideas  about  per¬ 
sonality  testing,  together  with  the  outline  for  the  Inkblot 
Test,  in  1921.  His  invention  of  the  test  resulted  from  "sua 
experimental  Investigation  in  fonn  perception".  In  this  in¬ 
vestigation  he  found  that  manlcs,  schizophrenics,  and  other 
abnozmel  grovps  had  different  chazacterlstic  waiys  of  per¬ 
ceiving.  He  used  inkblots  since  tlwy  contained  no  particu¬ 
lar  designs,  and  thereby  allowed  a  maximum  oppoirtunlty  for 
the  i)er8on  tested  to  display  his  own  personality  in  his 
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responses.  The  Inkblot  Test  Is  thus  an  investigation  of  a 
person's  characteristic  responses  to  neutral,  standardized 
stimuli.  liorschach's  methods  of  personality  assessment  are 
now  considered  part  of  a  larger  group  of  methods  (projective 
techniques)  all  characterized  by  the  c^iportunlty  for  the 
subject  to  "project"  his  personality  difficulties  Into  dif¬ 
ferent  fozms,  situations  and  Individuals. 

Limitation  of  Approach. 

Most  of  the  methods  auid  approsuihes  to.  the  study  and 
evaluation  of  personality  mentioned  above  are  not  adaptable 
to  a  leorge-scale  survey.  For  this  reason,  among  others. 
Project  Talent  adopted  an  Inventory,  self-report  approach. 
The  remainder  of  this  review  is  accordingly  limited  to  such 
Instruments. 

The  Advent  of  the  Inventory 

Woodworth's  Personal  Data  Sheet.  Personality  assess¬ 
ment  was  In  a  highly  experimental  state  at  the  beginning  of 
World  War  I.  World  War  I  had  a  profound  effect  on  person¬ 
ality  assessment.  For  the  first  time,  the  Aimed  Services 
were  inducting  men  in  wholesede  numbers.  A  strong  need  soon 
arose  for  diagnosing  the  ability  of  those  men  to  euljust 
themselves  satisfactorily  to  the  strains  and  stresses  of 
military  life. 

Obviously,  It  was  not  possible  for  the  number  of  psy¬ 
chologists  available  to  interview  personally  every  man 
drafted.  '  The  need  was  for  a  quick,  paper-and-pencil  type 
of  screening  device  which  could  be  adalnistered  in  whole¬ 
sale  lots  to  draftees  by  relatively  untrained  personnel. 

in  1917 

It  was  to  fill  this  need  that  R.  S.  WoodwortV developed  the 
first  of  the  group  personality  tests,  his  now  famous  Personal 
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Data  Sheet  (sometimes  referred  to  in  the  psychological  lit¬ 
erature  as  the  Woodworth  Psychoneurotic  Inventory). 
Development  of  the  Personal  Data  Sheet.  The  Personal  Data 
Sheet  (Woodworth,  1939>Pp*  18-I9)  was  an  attempt  to  stand¬ 
ardize  a  psychiatric  interview.  In  preparing  the  Data  Sheet, 
Woodworth  gathered  information  from  psychiatric  literature 
and  from  conferences  with  psychiatrists.  From  this  infor¬ 
mation  he  constructed  questions  answer^le  by  Yes  or  No. 

These  questions  were  intended  to  reveal  such  symptoms  as 
moodiness,  guilt,  and  functioned,  physical  symptoms.  The 
questions  were  generally  of  two  types:  those  referring  to 
the  past  history  of  the  subject  euid  those  referring  to  his 
present. 

Woodworth  submitted  the  Data  Sheet  to  standeutLlzatlon 
groups  of  "normal"  individuals  and  hnown  neurotic  patients. 

No  items  answered  unfavorably  by  or  more  of  the  normal 
group  were  retained.  The  score  made  by  a  subject  on  the 
Data  Sheet  was  taken  to  be  the  total  number  pf  unfavorable 
responses  (sometimes  Yes,  sometimes  No).  If  this  score  was 
excessive  in  compeurison  with  that  to  be  expected  from  the 
normal  standardization  group,  neurotic  symptoms  were  assumed 
to  be  indicated.  A  psychiatric  interview  was  then  arranged 
for  the  person. 

Woodworth  sigreed  that  the  Personal  Data  Sheet  was  only 
a  screening  device,  but  it  was  considered  successful  for  this 
purpose.  This  test  was  the  first  widely  used  exaaple  of  the 
questionnaire-inventory  Approach  to  peracmality  assessment, 
and  set  the  pattern  for  many  similar  questionnaires  following 
the  war. 

Outgrowths of  the  Personal  Data  Sheet.  The  Impetus  of  the 
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war  plus  the  success  of  Woodvorth's  Personal  Data  Sheet 
kicked  off  a  strong  spurt  of  enthusiasm  for  personality 
assessment.  Many  of  the  tests  which  resulted  were  direct 
outgrowths  of  the  Personal  Data  Sheet,  both  in  terns  of  form 
and  content.  Some  of  these  tests  Introduced  one  or  more 
changes  In  Woodworth's  procedvures,  and  most  confined  them¬ 
selves  to  the  measurement  of  "neurotlclsm” ,  "emotional  sta¬ 
bility",  "introversion-extroversion",  and  the  like. 

Scane  of  the  changes  tried  out  during  this  period  were 
the  use  of  a  graphic  sced-e  (Laird,  ,  where  the  subject 

indicated  his  choice  by  placing  a  check  mark  on  a  line  In¬ 
stead  of  answering  "Yes",  "No"  or  "?",  Another  (Heidbreder, 
19^6, '27)  Introduced  the  idea  of  selecting  Items  by  measur¬ 
ing  how  well  they  predicted  ratings  of  the  subjects  made  by 
themselves  and  their  friends.  In  another,  Q.  W.  and  7.  H. 
Allport  (1924,  1928)  experimented  with  the  use  of  items  com¬ 
posed  of  descriptions  instead  of  statements  (for  exanqple: 

"At  a  reception  or  tea  do  you  seek  to  meet  the  most  Impor¬ 
tant  person  present?").  In  addition,  they  developed  an  im¬ 
portant  new  idea  In  scoring- -giving  different  items  differ¬ 
ent  weights  in  determining  the  total  score. 

Another  important  innovation  was  made  by  L.  L.  Thxirstone 
In  his  1928  Personality  Schedule.  This  Schedule  consisted  of 
Items  designed  to  measxu'e  "Neurotic  Tendency".  Thurstone 
decided  which  answers  were  to  be  considered  symptomatic  of 
neurotic  tendency.  The  Bchedvile  was  given  to  694  freshnan 
college  students.  Scores  were  obtained  by  counting  the 
questions  to  which  "neurotic"  answers  were  given,  l^urstone 
then  selected  the  ^  most  and  30  least  neurotic-scoring  in¬ 
dividuals.  He  then  went  through  the  test  item  by  item. 
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counting  for  each  item  the  actual,  number  of  "neurotic"  an¬ 
swers  given  by  each  group.  He  Justified  his  original  assign¬ 
ment  of  scoring  weights  to  the  items  by  noting  that  the  high 
scoring  group  gave  "neurotic"  answers  more  frequently  than 
the  low  scoring  groups.  No  external  standard  of  "neurot- 
iclsm"  was  used.  Thus,  items  were  retained  in  the  Thurstone 
inventory  on  the  basis  that  they  agreed  well  with  his  a 
priori  keying.  Such  "internal  consistency"  methods  have 
since  been  widely  applied  in  the  development  of  personality 
inventories. 

An  additional,  step  in  the  development  of  one-dimensional 
personality  assessment  is  represented  by  the  Terman-Miles 
Attitude-Interest  Analysis  Masculinity -Peminlnty  Test  (1936). 
An  external  criterion  was  used  for  the  determination  of  item 

significance  as  in  the  case  of  Heldbreder  and  the  Allports; 

> 

however,  in  this  case,  the  criterion  groups  were  selected  in 
advance  on  a  completely  external  basis,  and  the  test  scores 
had  no  pazt  in  their  selection.  Thus,  the  measurement  ap¬ 
proach  was  to  select  items  to  differentiate  these  predeter¬ 
mined  groups  rather  than  to  select  items  to  measure  a  visu¬ 
alized  trait  and  then  to  define  criterion  groups  in  terms  of 
the  visualized  trait. 

'■4 

Summary.  At  this  p>oint,  it  appears  profitable  to  p>ause  and 
briefly  summarize  the  developments  in  personality  assessment 
from  the  historical  Woodworth  Personal  Data  Sheet  to  about 
1930.  During  this  i>erlod,  the  success  of  the  Personal  Data 
Sheet  as  a  quick,  relatively  satisfactory  device  for  screen¬ 
ing  military  personnel  for  neurotic  instability  led  to  a 
boom  in  personality  assessment.  Literally  hundreds  of  tests 
were  developed;  only  a  few  of  these  measures  have  been 
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mentioned. 

This  period  saw  the  rise  and  fall  of  measures  of  per¬ 
sonality  of  many  kinds,  including  the  first  of ^ the  major 
projective  instruments.  The  period  was  characterized  by  a 
*  large  number  of  self-report  inventories,  more  or  less  trace- 

able  to  the  Personal  Data  Sheet.  Virtually  all  of  the  in¬ 
ventories  of  this  period  were  single  ilmensional  in  charac¬ 
ter,  measuring  such  traits  as  "Neurotic  Tendency",  Intro¬ 
version-Extroversion",  and  "Ascendance-Submission".  Numer¬ 
ous  variations  of  the  "Yes-No"  type  of  response  were  tried 
out,  including  graphic  rating  scales,  algebraic  summation  of 
unit  item  Weights  and  algebraic  summation  of  differential 
H  item  weights. 

Particulaxly  important  was  the  emergence  of  a  number  of 

Ml 

.  distinct  procedures  for  item  selection.  These  included  the 

following  major  types: 

4 

a.  Judgment. 

For  example,  items  were  included  in  Woodworth's 
Personal  Data  Sheet  primarily  on  the  basis  of  his 
judgment  and  tliat  of  psychiatrists. 

b.  External  Correlation. 

For  example,  Heidbreder  and  the  Allports  cor¬ 
related  their  items  with  external  criteria,  namely 
the  ratings  of  the  subject's  associates. 

c.  Internal  Consistency. 

For  example,  Thurstone  related  his  items  to 
total  score  on  his  Neurotic  Inventory  by  ccanparing 
the  dumber  of  neurotic  answers  for  the  item  for 
those  scoring  high  on  the  test  to  the  number  of 
neurotic  answers  for  the  items  for  those  scoring 
low  on  the  test. 

Multidimensional  vs.  Unidlmensional  Inventories.  Unidimen- 
sional  tests  dealt  with  measurement  along  one  defined  dimen¬ 
sion  or  trait  at  a  time,  ^.g. ,  introversion-extroversion. 

While  many  such  tests  are  in  use  today,  they  atre  often  re¬ 
served  for  special  purposes,  e.£. ,  Wallen's  (19U3)  Food 
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Aversion  Test,  Taylor's  (1953)  Anxiety  Scale,  Cassel's 
(1952)  Level  of  Aspiration  Test,  and  Maslov's  (19^5)  Securi¬ 
ty-Insecurity  Test.  Most  personality  inventories  today  are 
of  the  multidimensional  tji^. 

In  seme  cases,  a  multidimensional  Inventory  is  simply 
a  group  of  unidimensional  inventories  under  the  same  cover. 
In  other  cases  it  may  contain  an  entirely  different  approach 
to  test  construction,  such  as  the  one  Bemreuter  (see  below) 
used. 

The  unidimensional  tests  discussed  in  the  previous 
section  were  widely  used.  However  some  investigators  soon 
began  to  search  for  more  efficient  ways  of  assessing  per- 

’1 

sonality  since  the  unidimensional  approach  either  focused 
attention  on  one  aspect  of  the  subject's  personality,  or 
else  required  the  administi'ation  of  a  separate  test  for 
each  trait  in  question. 

The  unidimensional  tests  were  based  upon  the  assump¬ 
tion  that  a  given  behavior  was  related  to  one  trait.  The 
new  type  of  multidimensional  inventory  was  an  attempt  to 
test  the  assumption  that  a  given  behavioral  element  (an 
item)  could  be  related  to  several  different  traits,  and 
thus  might  appear, differently  weighted,  in  more  than  one 
scale  of  measurement.  This  assumption,  if  supported,  could 
make  possible  the  construction  of  tests  which  would  simul¬ 
taneously  measure  several  traits  with  the  same  items. 

The  Bernreuter  Personality  Inventory 
The  Original  Inventory. 

The  Bemreuter  Personality  Inventory  was  the  first  one 
of  this  latter  kind  of  multidimensional  inventory.  The 
development  has  been  described  in  detail  by  various  authors 
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Including  Ferguson  (1952).  A  discussion  of  the  theory  un¬ 
dertying  this  inventory  is  available  in  Bemreuter  (1933)* 

Bemreuter's  Personality  Inventory  vas  first  published 
in  1932.  It  consists  of  125  items  answerable  by  ’’Yes”  or 
"No”,  drawn  from  four  earlier  unidimensional  tests;  Laird's 
C-2  Introversion  Test,  the  Allport's  Ascendance-Submission 
Reaction  Test,  Thurstone's  Neurotic  Inventory  and  Bem¬ 
reuter's  own  Self-Sufficiency  Test.  The  inventory  was  in¬ 
tended  to  measure  simultaneously  the  four  dimensions  meas- 
"  ured  by  these  tests,  and  contained  four  scales  called  Neu¬ 
rotic  Tendency,  Self-Sufficiency,  Introversion-Extroversion, 
and  Dominance-Submission. 

After  the  items  were  assembled,  Bemreuter  gave  a  trial 
form  of  the  inventory  together  with  the  four  original  tests, 
to  about  four  hundred  students  from  various  universities. 
Using  these  scores,  Bemreuter  selected  groups  to  represent 
extreme  scores  on  each  of  the  tests.  For  each  trait  meas¬ 
ured  by  the  Inventory,  there  were  two  groups:  50  high- 
scorers  (25  men,  25  women)  and  50  low  scorers  (25  men,  25 
women).  Bemreuter  then  computed  scoring  weights  for  each 
question  on  the  Inventory.  Different  weights  were  assigned 
to  the  same  items  for  different  traits,  depending  upon  the 
extent  to  which  the  item  differentiated  the  high  and  low 
score  groups  for  that  trait.  The  subject's  score  on  a  given 
scale  is  the  algebraic  sum  of  the  weights  for  his  answers  in 
that  scale. 

Several  items  in  the  Inventory  are  given  below,  edong 
with, for  exan^le,  their  scoring  weights  on  two  of  the 


scedes: 


YLIl~lk  ‘ 

Meu.Tend.  (B3^)  Self -Buff.  (B^S) 


Yes 

No 

1 

Yes 

Ho 

1 

Are  you  troubled 
with  stress? 

6 

-7 

1 

-1 

1 

-1 

Have  books  been 
more  entertaining 
to  you  than  ccaopanlons? 

3 

-2 

-1 

2 

-3 

1 

Do  you  prefer  making 
hurried  decisions 
alone? 

-1 

1 

-2 

6 

-6 

-1 

Bemreuter  found  generally  satisfactory  reliability  co¬ 
efficients  for  his  scales  (split-half  coefficients  ranging 
from  .82  to  .9l)*  In  addition^  he  demonstrated  that  his 
four  test  scales  correlated  virtually  perfectly  (when  cor¬ 
rected  for  attenuation)  with  the  four  tests  they  were  sup¬ 
posed  to  replace,  respectively.  It  therefore  seems  clear 
that  Bemreuter' s  original  idea  that  one  set  of  items  can 
be  weighted  differently  and  can  serve  several  purposes  at 
one  time  is  well-supported.  However,  the  demonstration  of  : 
relationship  with  the  original  four  tests,  is  still  not  a 
good  demonstration  of  the  validity  of  the  Inventory,  since 
the  original  four  tests  have  only  modest  validity. 

’  .  The  Flanagan  Revision. 

Flanagan's  (1935)  factor  analysis  of  Bemreuter' s  Per¬ 
sonality  Inventory  was  a  pioneer  effort  in  the  application  of 
a  new  statistical  technique--factor  analysis— to  the  area  of 
personality  testing.  Struck  by  the  high  Intercorrelation  of 
Bemreuter' s  scales,  Flanagem's  objective  was  to  replace  the 
arbltrsLTy  construction  of  the  trait  definitions  with  a  method 
for  sclentlflcedly  obtaining  significant  tradts.  Bemreuter 
had  selected  four  personality  traits,  atnd  provided  scores  on 
each.  Flanagan  gave  the  Inventory  to  30^  adolescent  boys 
and  obtained  the  intercorrelations  shown  below: 
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« 


Neurotic  Tendency  (Bl-N) 

Self-Sufficiency  (B2-S) 

HBtoprursiim  (B3-I) 

.  Damlnance  (B4-D) 

He  then  applied  Hotelling’s  principal  components  factor 
analysis,  arid  foiind  that  two  dimensions  rather  than  four, 
were  able  to  account  for  virtually  all  of  the  individual 
differences  in  test  pcores. 

Flanagan  then  re-worked  his  data,  and  in  trying  his  new 
keys  out  on  groups  of  children,  he  found  good  reliabilities 
(.86  and  .78)  and  a  very  low  interrelationship  (.04)  between 
his  new  dimensions,  showing  that  they  represented  two  really 
different  aspects  of  personaility. 

Flanagan's  work  resulted  in  the  addition  of  two  scales 
to  the  original  Bernreuter,  one  of  which  he  called  Self- 
Confidence  (Fl-C)  and  one  which  he  called  Sociability  (F2-S). 
The  present  edition  of  the  test  contains  all  six  scales, 
although  Flanagan's  two  scales  may  be  used  alone  instead  of 
the  original  four  scales. 

Flanagan's  work  was  historic  in  its  application  of  fac¬ 
tor  analysis  to  the  personality  inventory.  Nevertheless,  he 
worked  with  the  original  Bernreuter  material  and  of  course 
his  scales  atre  subject  to  the  limitations  contained  in  that 
material. 

Further  Factor  Analytic  Developments 
Factor- based  Tests. 

Flanagan success  at  applying  factor  analysis  to  per¬ 
sonality  measurements  initiated  a  widespread  interest  in  this 
technique,  and  a  number  of  the  instruments  developed  in 
recent  years  have  been  based  upon  a  factor  analytic  approach. 


B2-S  B3-I  B4-D 

-.39  487  -.69 

-•3  .51 

-.62 
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Those  In  favor  of  factor  analytic  approaches  have  argued 
that  factor  analysis  penaits  the  description  of  human  behav> 
ior  in  terms  of  a  relatively  few,  relatively  independent, 
more  basic  dimensions.  Several  notable  exanqples  of  the  use 
of  factor  analysis  in  this  area  are  mentioned. 

The  Guilford  Itprentories.  These  inventories,  de¬ 
veloped  from  1936-1939^  represent  extensive  use  of  factor 
analysis.  Vlhereas  Flanagan’s  application  of  factor  analysis 
to  the  Bemreuter  vas  based  on  the  relationships  (intercor- 
relatlons}  among  scores  on  the  four  scales,  Guilford  analyzed 
the  relationships  amoxig  Items.  This  process  enabled  Guilford 
to  define  an  estimated  number  of  related  factors,  rather  than 
having  to  start  with  a  ntmiber  of  scales  developed  by  theoriz¬ 
ing  and  then  refining  these  into  a  number  of  factors.  Thus 
Guilford  used  factor  analysis  as  a  basic  scale  construction 
technique,  assigning  item  scoring  wel^ts  In  rough  agreement 
with  their  Importance  to  the  factors  (factor  loadings). 

The  Guilford  Inventories  cover  13  traits  in  three  Inven¬ 
tories  as  follows: 

a)  An  Inventory  of  Factors  STDCR  (Social  intro- 
version-extroversion,  thinking  introversion- 
extroversion,  depression,  cycloid  disposition, 
and  rhathymia  or  carefree  disposition). 

h)  The  Guilford-Martln  Personal  Inventory  (ob¬ 
jectivity,  cooperativeness,  and  agreeableness). 

c)  An  Inventory  of  Factor  GAMIN  (general  activity, 
ascendazx^e-submission,  masculinity-femininity, 
inferiority  feelings  and  xtervousnesa) . 

An  Inventory  of  Factors  STDCR  was  developed  basically 
from  a  number  of  sources,  including  Jung's  writings,  Freyd's 
monograifli  (1924),  and  several  earlier  introversion-extrover¬ 
sion  inventories.  Centroid  factor  analysis  of  the  inter- 
correlations  of  the  items,  based  on  the  scores  of  610  men 


and  390  voaeiLf  formed  the  baala  for  the  Initial  form  of  the 
Inventory.  The  development  of  the  final  form  la  not  exactly 
described. 

An  Inventory  of  Factors  GAMIN  vas  designed  In  much  the 
sane  vay  to  test  the  Idea  of  an  activity  drive*  It  vas  also 
supplmnented  by  material  from  other  studies.  The  Gollford*- 
Martln  Personnel  Inventory  followed  the  sane  general  f^ttem 
of  development^  and  was  Intended  to  assist  In  the  Identlflca** 
tlon  of  maladjusted  workers  and  to  extend  the  list  of  traits 
already  assessed  by  the  other  Inventories. 

Reliability  coefficients  for  the  13  factors  are  good  (from 
.do  -  .9^)  and  some,  though  not  a  great  deal,  of  evidence  has 
been  collected  as  to  the  validity  of  the  inventories. 

The  Guilford  Inventories  demonstrated  among  other  things 
the  utility  of  factor  ajialysls  In  sceae  construction  and  In 
clarification  of  old  concepts.  For  example,  the  development 
of  the  Inventory  of  Factors  STDCR  clearly  suggested  that  the 
old  idea  of  introversion-extroversion  is  not  a  single  trait, 
but  is  composed  of  at  least  five  sub-traits. 

The  Thurstone  Temperament  Schedule.  The  interrelationships 
among  the  original  13  factors  isolated  by  Guilford  were  quite 
high.  This  fact  led  a  number  of  researchers  to  re-analyze 
Guilford  data.  Thurstone  (l95l)  carried  out  such  a  re-analysis 
and  concluded  that  seven  major  factors  were  sufficient  to  - 
account  for  virtually  all  of  the  Information.  These  sevmi 
traits  were  described  by  Thurstone  (1950)  as  follows; 

Active  (A)  —  Working  rapidly,  even  lAien  not  neoes* 
sary}  restless. 

Vigorous  (V)  —  Ihyslcally  very  active  using  large 
muscles  and  mucdi  energy;  outdoors, 
sports,  manual  work  activities. 

Ii^pulslve  (l)  ~  Quick  decisions,  carefree,  happy- 
go  lucky. 
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DoBdnant  (d)  —  Leadership  initiative,  responsible. 

Stable  (E)  Cheerful,  even  disposition. 

Sociable  (s)  Enjoy  coapany  of  others,  «ake  trlmHB 
easily,  sympathetic,  cooperative. 

Reflective  (r)  --  Quiet,  work  alone, 
theoretical. 

The  reliability  coefficients  of  the  scades  are  gener- 
ally  regarded  as  relatively  lov  (ranging  from  .4^  -  .86,  for 
different  scales  In  different  studies).  In  addition,  the 
Interrelationships  of  Thurstone's  seven  primary  factors,  were 
surprisingly  hl^  (in  two  cases  .71  and  .52),  considering  the 
techniques  used.  V8j.ldlty  studies  involving  this  schedule 
are  relatively  scarce,  and  many  reviewers  recommend  Its  use 
for  research  purposes  only. 

Cat tell  Tests.  Some  of  the  most  extensive  quantitative 
research  yet  done  In  the  area  of  personality  evaluation  has 
been  done  by  Cattell  (1946,  1957)*  effort  to  develop 

a  comprehensive  description  of  personality,  Cattell  started 
with  the  Allpoirt  and  Odbert  (193^)  list  of  almost  18,000 
trait  names.  He  reduced  this  to  171  by  combining  closely 
related  concepts,  and  began  his  factor  analytic  studies  of 
these  traits. 

A  number  of  l]iq>ortant  points  about  Cattell*  s  work  must 
be  mentioned.  First,  he  has  set  up  a  systematic  plan  for 
Investigating  the  area  of  personality  assessment;  second, 
he  has  rejected  the  Idea  of  traits  taken  by  themselves  and 
ha«  Insisted  that  they  must  be  dealt  with  In  terms  of  the 
conditions  or  situation  Imsedlately  present;  and  finally, 
he  has  distinguished  between  "surface”  traits  "source" 
traits,  the  latter  corresponding  to  factors  idilch  give  rise 


VIII -19 

to  the  sxirface  traits  but  can  only  be  discovered  by  mathe¬ 
matical  analysis  euid  psychologiced  insight. 

As  might  be  expected,  Cattell  has  devised  a  number  of 
tests  to  measure  the  factors  growing  out  of  his  stxidies. 

Two  examples  are: 

a)  The  Sixteen  Personality  Factor  Qwest lonnalre. 
The  inventory  was  constructed  to  measure  12  of  the  source 
traits  found  in  Cattell’ s  early  factorial  studies  and  four 
additional  ones  obtained  from  the  study  of  questionnaire 
resx>onse8.  Qwestions  axe  of  the  "Yes”,  "In  between",  or 
"No"  type.  Good  reliability,  coefficients  (split-half,  in 
the  .71  to  .93  range,  based  on  ^50  cases)  were  reported. 
Considerable  valldational  work  is  underway.  The  manual  is 
not  clear  on  the  developmental  details  of  the  test,  but  re¬ 
viewers  have  agreed  that  a  large  amount  of  statistical  work 
has  gone  into  the  test,  and  that  it  is  likely  to  prove  a 
significant  step  in  the  assessment  of  personality. 

b)  The  Objective -Analytic  Personality  Test  Bat¬ 
teries.  Published  by  Cattell,  al.,  in  1955,  these  tests 
consist  of  one  adult  battery  designed  to  cover  18  of  Cattell' s 
source  trait  factors  (Cattell’ s  Universal  Index  Numbers 
16-33)  Uy  43  group  tests  or  54  Individual  tests  (also  avail¬ 
able  in  abbreviated  foims  for  12  of  these  factors,  and  for 
single  factor  batteries). 

These  tests  require  that  the  user  be  thoroughly  grounded 
in  Cattell* s  complex  system  of  concepts,  tenns,  and  theories. 
In  addition  to  the  convexity  of  the  theoretical  system  in¬ 
volved,  however,  the  average  test  user  will  find  little  evi¬ 
dence  as  to  the  relationship  of  these  batteries  to  clinical, 
industrial,  and  other  outside  criteria,  no  norms,  and  no 
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data  on  reliability.  Thus,  while  the  pronlse  of  these  bat¬ 
teries  may  be  great,  they  are  primarily  restricted  to  the 
researcher  at  the  present  time. 

Summary.  The  vork  listed  above,  as  well  as  tha-t  other 
researchers ,  Illustrates  the  vEorlety  of  steps  being  taken 
through  the  techniques  of  factor  analysis  to  attend  to 
better  define  and  measxire  personality.  In  spite  of  the  ex¬ 
perimental,  highly  ccaaplex,  and  mechanistic  nature  of  the 
methodology  employed,  considerable  progress  appears  to  have 
been  made  with  more  expected  In  the  near  future. 

Non-?actor  Multidimensional  Inventories 
■  General 

Althovigh  the  Flanagan  treatment  of  Bemreuter' s  Per¬ 
sonality  Inventory  was  a  significant  step,  the  development 
of  multidimensional  inventories  was  not  confined  to  those 
based  on  factor  analysis.  Seme  of  the  more  prominent  of 
the  early  multidimensional,  non-factor  tests  are  mentioned 
below. 

The  Bell  Adjustment  Inventory.  This  widely  used 
inventory  has  two  forms,  one  for  high  school  and  college 
students  (prepared  in  193^)  and  another  for  adults  (1938). 

The  adjustment  areas  measured  by  the  inventory  are:  home, 
health,  emotional  and  occupational.  The  inventory  Is  self- 
administering,  sttid  the  score  for  each  eu:ea  is  the  number  of 
significant  answers  marked  by  the  subject.  Area  scores  can 
be  summed  to  obtain  a  total  adjubtment  score  for  men  and 
women  in  high  aohool,  college,  and  at  the  adult  levels. 

The  test  distinguished  well  between  two  groups  of  ad\d.t8 
classified  as  very  well  and  very  poorly  adjusted  by  counsel¬ 
ing  experts.  Good  reliability  coefficients  have  been 


reported  (from  .8l  to  .9^)>  Its  chief  use  Is  as  a  large> 
scale  screening  device  since  the  assumption  that  each  quest¬ 
ion  contributes  to  only  one  adjustment  area  Is  questionable, 
and  the  various  areas  appear  to  be  highly  related. 

'■ .  ,  The  Minnesota  Multlphaslc  Personality  Inventory 
(MMPI).  One  of  the  most  widely  used  of  personality  tests, 
the  MMPI  TOs  developed  in  19^0  by  S.  R.  Hathaway  and  J.  C. 
McKinley  for  the  purpose  of  psychiatric  evaluation.  The 
inventory  consists  of  more  than  500  statements  to  be  an¬ 
swered  "True”,  "iblse’*  euad  "Cannot  say".  Items  were  se¬ 
lected  for  the  final  test  only  if  they  showed  a  large  per¬ 
centage  frequency  difference  between  a  criterion  patient 
group  and  a  nomal  group.  The  clinical  scales  in  general 
use  are;  hypochondriasis,  depression,  hysteria,  psychasthenia, 
schizophrenia,  hypomanla,  and  sociel  introversion-extro¬ 
version.  Test-retest  reliability  coefficients  for  these 
scales  range  from  .46  to  .93*  There  are  sepeurate  norms 
for  men  and  women,  although  a  number  of  investigations  have 
indicated  that  these  norms  are  too  general,  and  need  work. 

One  of  the  most  important  features  of  the  MMPI  is  the 
attempt  to  provide  control  scales  to  indicate  the  attitude 
of  the  subject  taking  the  test.  The  "T"  scale  indicates 
the  extent  of  omissions  in  responses;  the  "L"  (lie)  score 
measures  the  degree  to  which  social  desirability  is  influ¬ 
encing  the  responses;  the  "F"  (validity)  score  is  designed 
to  identify  indiscriminate  markings,  carelessness,  lack  of 
understanding,  etc.$  and  the  "K"  (correction)  scale  is  be¬ 
lieved  to  indicate  the  person's  test -taking  attitude— de¬ 
fensive,  rigid,  self -critical,  etc.  While  these  four  scales 
have  not  been  completely  successfvil,  they  have  contributed 


VIII -22 


greatly  to  the  success  of  the  MMPI. 

For  its  purpose  (psychiatric  evaluation),  the  MMPI  is 
generally  considered  one  of  the  most  valid  of  available 
questionnaire  instruments. 

..  Forced  Choice 

The  general  self-report  inventory,  even  though  it  might 
be  scored  for  several  dimensions,  came  in  for  considerable 
criticism  in  several  respects.  Many  studies  have  demon¬ 
strated  that  people  could  present  veiy  unreal  views  of  them¬ 
selves  when  this  seemed  desirable  to  them.  This  situation 
is  particularly  bad  where  a  person  may  have  something  to 
gain  by  presenting  a  false  picture  of  himself,  as  in  in¬ 
dustry  or  the  military.  In  other  cases  people  have  experi¬ 
enced  great  difficulty  in  choosing  "Yes",  "No",  or  "?"  as 
an  answer  to  a  question.  In  response  to  these  criticisms, 
several  psychologists,  notably  Jurgensen  (l9^)>  Sisson  (19^8), 
and  Shipley  (19^6),  developed  the  "forced  choice  technique". 
Essentially,  the  subject  is  required  to  choose  between  two 
alternative  statements  or  answers  which  appeeu:  equally  de¬ 
sirable  or  acceptable,  but  which  differ  with  respect  to  their 
scoring  weights  for  the  trait  in  question. 

Where  the  paired  alternatives  are  effectively  equated 
for  social  acceptability  and  apparent  desirability  for  the 
group  in  question,  the  opportunity  for  feiking  is  reduced. 

In  suidition,  by  requiring  a  relative  rather  than  an  absolute 
Judgment,  the  forced  choice  item  tends  to  reduce  the  ambigu¬ 
ity  usually  associated  with  items  such  eis  "often",  “rarely", 
etc. 

In  using  the  forced  choice  technique,  fakability  and 
ambiguity  are  reduced  but  not  eliminated.  Whenever  the  person 
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who  takes  the  test  has  a  strong  reason  to  present  himself 
In  a  particular  light,  he  can  usually  do  so  to  some  extent, 
depending  on  hov  obvious  the  relationships  are  of  the  state* 
ments  In  the  Item  to  the  traits  being  measured.  Where  there 
Is  little  reason  to  fake,  the  traditional  self •report  type 
of  Inventory  nay  be  preferable  by  virtue  of  Its  greater 
slxqpllclty  and  understandablllty. 

.  Beaeat  JBYfiBtorlaB 

This  section  suonarlzes  a  fev  recent  multl-dlmenslonal 
Inventories.  A  considerable  number  of  single-dimension  In¬ 
ventories  are  still  being  produced  for  special  purposes, 
but  in  most  cases  have  not  found  particularly  vldespreeui 
usage.  While  factor-based  batteries  appear  from  time  to 
time  and  forced  choice  fom  Is  quite  popular,  the  traditional 
tralt-orlented,  self-report  Inventories  are  still  used  In 
large  numbers.  It  should  be  noted  that  the  Project  Talent 
test  made  no  effort  to  Include  edl  the  areas  covered  by  the 
tests  described  below.  The  tests  reviewed  here  simply  Illus¬ 
trate  some  of  the  directions  presently  being  taken  by  test 
producers  In  their  attempts  to  assess  personality  by  mesuas 
o'f  self-report  inventories. 

-  California  Test  of  Personedlty.  (Thorpe,  Clsurk 
and  Tlegs).  This  Inventory,  originally  published  in  1942, 
was  revised  considerably  In  1933,  at  least  peurtly  as  a  re¬ 
sult  of  fairly  severe  criticisms  by  reviewers.  The  test  Is 
of  the  tradltlOTal  **100—110"  type,  and  la  really  a  battery 
of  five  teats  for  different  age  levels*  It  assesses  two 
general  areas:  Personal  Adjustment  Includes  self-reliance, 
sense  of  personal  worth,  sense  of  personal  freedom,  feeling 
of  belonging  and  freedom  from  withdrawing  tendencies  and 


nervous  symptaas)  Social  Adjustment  includes  socl^  sten* 
derds.  social  skills,  freedom  from  antisocial  tendencies, 
family  relations,  school  (or  occvq^tional)  relations,  and 
conaunity  relations.  The  questions  in  the  test  attempt  to 
elicit  Infoxnation  indirectly.  Rather  than  demanding  "Do 
you  hate  people?”  the  test  asks,  "Are  certain  people  so  un» 
x^asonahle  that  you  hate  them?”  The  authors  feel  this  en« 
ahles  the  subject  to  "save  face”  and  thus  encourages  him  to 
answer  more  freely.  This  test  assumes  that  the  subject  is 
constantly  adjusting  to  problests  and  attcsipts  to  evaluate 
his  adjustment. 

While  the  test  has  undergone  much  internal  consistency 
and  other  statistical  work  designed  to  strengthen  Its  valid¬ 
ity  and  reliability,  it  still  possesses  some  defects.  The 
reliability  coefficients  of  the  two  part  scores  and  the 
total  score  (alternate  from  confutation)  are  .90,  .69,  and 
.93,  respectively.  However,  diagnostic  or  profile  inter¬ 
pretations  based  on  the  sub-test  scores  are  questloxmble  due 
to  the  somewhat  lover  reliability  of  these  sub-test  scores. 
The  intercorrelations  of  the  vturious  scores  are  also  quite 
high.  Hew  validity  studies  based  on  the  19^3  revisions  are 
reported  in  the  manual  and  the  results  are  moderately  favor¬ 
able. 

The  California  Psychological  Inventory  (Gough). 

% 

One  of  the  most  recent  inventories,  published  in  1957,  this 
test  VM  designed  to  deal  with  widely  applicable  ohareeter- 
Istics  of  human  b^vtor,  and  eapbasitea  positive  ami  fav¬ 
orable  aspects  of  personality  rather  than  ataoxmall^.  The 
test  is  coBfosed  of  460  "True— laise”  items,  many  derived 
from  the  M(PI,  ranging  over  an  exceptionally  vide  content. 
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Eleven  scales  vere  derived  from  external  criteria^  and  four 
from  items  Judged  to  be  homogeneous.  Finally;,  three  "con¬ 
trol''  keys  were  developed,  similar  in  purpose  to  those  de¬ 
veloped  for  the  MilPlt  Sense  of  Well-being  (Vb),  based  on 
responses  given  by  normals  told  to  present  a  bad  picttire  of 
themselvesj  Good  impression  (Gi),  based  on  responses  of 
normals  told  to  present  good  impression^  and  Ccmmunallty 
(Ca),  the  highly  popular  responses.  A  marked  deviation  on 
a  control  score  casts  doubt  on  the  individual’s  other  scores. 

While  the  manual  is  not  complete  with  respect  to  all 
details  of  scale  development,  the  procedure  was  essentially 
tota)  assemble  a  large  stock  of  significant-appearing  per¬ 
sonality  items j  b)  identify  criterion  groups  differing 
sharply  on  some  dimensions  considered  socially  and/or  psy¬ 
chologically  significauat;  euad  c)  develop  a  scoring  key  ccm- 
posed  of  those  items  found  enqplrically  to  differentiate  the 
criterion  groups.  This  procedure -may  reduce  "faJsability", 
and  may  result  in  efficient  keys,  but  also  may  result  in  a 
series  of  dimensions  whose  meaning  is  not  clear. 

The  test-retest  reliability  coefficients  are  relatively 
low,  ranging  from  .38  to  .75  for  one  study,  and  .kg  to  .87  for 
another.  Considerable  validity  information  is  available  for 
such  a  new  test,  but  much  of  it  is  seriously  misleading,  be¬ 
ing  based  largely  on  Inappropriate  statistical  procedures. 

The  Edvards  Personal  Preference  Schedule.  This 
test,  published  in  1953)  inanual  revised  in  1957)  is  iu>table 
in  several  respects,  first,  it  is  based  solidly  ^xgon  psy¬ 
chological  theory.  Edwards  selected  15  of  the  Murray  (1938) 
psychological  needs  as  the  dimensions  to  be  measured  in  his 


test. 
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Second,  in  trying  out  an  early  version  of  the  test  in 
"True-False"  fom,  Edvards  found  that  the  frequency  of  en¬ 
dorsement  of  his  items  correlated  very  well  (.87)  with  their 
"social  desirability"  (as  scaled  by  a  jgroup  of  152  Judges). 

In  order  to  avoid  having  Jiest  scores  determined  primarily 
by  social  desirability,  Edwards  adopted,  a  'forced  choice" 
form  in  which  items  consisted  of  pairs  of  statements  from 
the  different  scales,  equated  for  scale  values  in  social 
desirability.  The  final  form  consisted  of  225  items  wherein 
statements  from  each  of  the  15  scales  were  paired  off  twice 
against  statements  from  each  of  the  other  l4,  and  15  pairs 
were  repeated  in  order  to  get  a  consistency  score. 

Acceptable  reliability  coefficients  are  reported  (.60  to 
.87  split-half,  corrected}  and  .7^  to  .88  test-retest  at  a 
one  week  Interval).  A  number  of  validity  studies  are  re¬ 
ported  in  the  manual,  some  of  which  include  a  modest  veli- 
dity  for  some  of  the  test  scores.  However,  a  study  by 
Corah,  Feldman,  jt  ,  found  highly  significemt  differences 
in  social  desirability  between  paired  statements  presumably 
matched  for  it,  and  thus  concluded  that  Edwards  had  not 
been  very  successful  in  controlling  social  desirability. 

Even  so,  the  test  is  widely  considered  to  be  a  very  promis¬ 
ing  instrument. 

The  SRA  Youth  Inventory  (Remmers,  Shimberg,  euad 
Drucker).  Published  in  19^9 >  manual  revised  and  technlced 
supplement  added  in  1953>  this  inventory  Is  somewhat  differ¬ 
ent  from  the  ones  discussed  above  in  that  it  is  geared 
specifically  to  the  assessment  of  "problems"  of  high  school 
youths.  The  298  items  were  derived  from  a  content  analysis 
of  "hundreds  of  essays"  written  anonymously  by  high  school 
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students  elsout  their  problems.  IThis  analysis  resulted  In  a 
division  of  the  problems  of  hl^  school  students  into  the 
eight  areas  covered  by  the  Inventory:  l)  school,  2)  Iiook- 
Ing  ahead  (to  college,  work,  etc.),  3)  Abpht  myself  (personal 
adjustment),  k)  Getting  along  with  others  (social  adjustment), 
^)  home  and  family,  6)  Boy  meets  girl  (dating,  marriage, 
etc.),  7)  Health,  8)  Ifhings  in  gener8LL  (vorld  affairs,  reli¬ 
gion,  social  ethics,  etc.).  Students  are  asked  to  check  all 
statements  vhlch  concern  one  of  their  problems.  Scores  are 
sljiqply!  the  nvlkkir  of  Items  checked  in  each  area. 

A  9th  score  may  be  obtained,  called  a  Basic  Difficulty 
score.  This  consists  of  the  number  marked  of  the  101  items 
that  all  or  6  of  7  experts  in  the  fields  of  psychology, 
guidance,  and  education  agreed  were  indicative  of  basic  per¬ 
sonality  difficulties. 

Problem  statements  were  classified  into  the  8  areas 
Judgmentally,  and  these  assignments  were  checked  by  internal 
consistency  procedures.  The  technical  supplement  reports  the 
8  areas  as  "fairly  homogeneous"  with  respect  to  both  statis¬ 
tics  and  face  validity,  but  the  statistical  criterion  is  net 
presented. 

Hellablllty  coefficients  (only  ^6  oases)  were  good  as 
computed  by  test-retest  methods  (,7&  to  i86)  for  the  eif^t 
areas  and  the  Basic  Difficulty  score.  Several  external  vali¬ 
dation  studies  are  reported  in  the  Technical  lupplmsent  whieh 
indicate  some  modest  validity  for  the  Basic  Difficulty  score 
in  identifying  adjustiient  :^bl«ss,  especially  for  girls. 

The  discrepancies  in  results  of  self-rating  and  rating  by 
others  are  clearly  brought  out,  however. 

The  noznative  sample  is  national  and  well-described. 
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The  author!  auggeat  the  use  of  the  inventory  as  an  adjunct 
to  the  eounsellag  intervlev  and  It  appears  that  for  this 
purpose  it  hhould  be  4,ttlte  useful  In  the  hands  of  profession¬ 
al  psychologists  and  counselors, 
a. 

Froa  adaost  the  beginning,  paper  and  pencil  personality 
tests  have  been  under  orltiolM  of  one  fort  or-asotharv 
Over  the  years  persons  such  as  Allport  Oazrett  (3933}> 

and  Bills  (1946^1933)  bave  voiosd  general  crltlclau  of  a 
consistent  natuze.  lilts  (1946)  has  suMsriasd  the  situation, 
Inoludlag  oQMon  objeotions  and  strengths  of '^personality 
guestloanaires,  based  upon  his  review  of  839  studies. 

Of  the  839  stvkdies,  6o  shoved  positive  valiAlty,  44 
lusstionabls  validity  and  133  to  validity  for  the  tuestlon- 
naire  being  studied.  Zntemal  oonslsteney  aeasufes  were 
not  oonsidored  Manures  of  validity.  Of  the  tuostionnalres 

j 

considered  in  these  studies,  oaSg  the  MR  showed  up  well 
with  6  poeitive  validity  studies  out  of  19  reviewed.  The 
lini^iu^.  h  voop  MtMdi  Zt  ehiuU 

he  Boted  however  that  nui'  eriterli  were  uiuiuiUy  ievere< 
(he  defieod  eorrelatioM  of  0  -  .Sf  hi  Miiay  Miitivei  i4o* 
.69  hi  tuestiMhhiy  positive  iid  iTO  up  hi  ihiBay  piiiti¥i)i 
^vefi  iihii  Sill  reviow  of  itudioi  ten  line  ifMt  lUii 
fouid  that  aero  roMireh  lad  eUaiehl  uio  wm  thoa  heiii 
aHo  of  pofioMUty  iiviHorUi  than  of  m  other  typo  of 
hiioiMiat  iaohnaMil. 

Mo  ptehlMief  pipor  oal  poaoii  porooaaUIr  taotlai  My 
he  luaMd  up  ia  hriot  ao  foUowii  loUiMlity  iala  iro 
in  aoit  eaiei  odeiuatoi  hut  prohleai  of  vaUlatioa  rua  ttooutfi 
mit  of  the  tests*  The  aain  iiiuoi  in  the  iolf«roport  typo 
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of  Invontoxy  center  around  three  areas: 

1.  )  Fi-Minwg.  Most  subjects  can  successfully  foUov 
instructions  to  fake  their  responses  in  isone  particular  my, 
even  those  vho  can't, often  present  a  distorted  picture  of 
thenselves. 

2.  )  8elf«insiflht  .  In  order  to  be  able  to  respond  vith 
valid  Infomatlon  about  himself,  the  subject  must  of  course 
be  avare  of  his  true  nature.  Studies  have  repeatedly  lOiovn, 
and  personal  experience  often  bears  this  out,  that  people 
often  aren't  aware  of  their  personal  gulrks  and  defects,  and 
thus  can  hardly  be  elected  to  report  them  in  response  to 

a  question. 

3 .  )  Reading  Load.  Inventories  often  run  to  several 
hundred  questions  in  their  efforts  to  obtain  auiceptable  va¬ 
lidity  and  reliability.  A  poor  reader,  Ecfter  strugglliig  with 
this  for  a'./l^ile,may  give  in  his  attempt  to  imderstand 
each  question  and  answer  an  unpredictable  number  of  them 
superficially,'  if  not  coopletely  randomly. 

Vhlle  the  reputation  of  personality  questionnaires  ap¬ 
parently  reached  a  low  point  with  the  publication  of  Ellis' 
1946  review,  and  '(dille  Super  (1949,  p.^27)  has  said  that 
pezhaps  the  major  trend  since  1930  has  been  .  away  from  the 
inventory  technique  and  toward  various  projective  devices, 
the  personality  Inventory  is  far  from  dead.  Indeed,  with 
the  work  of  the  factor  analysts,  and  the  development  of  a 
nuMber  of  refinements  such  as  forced  choice  form,  control 
scales,  and  attempts  to  nullify  the  effects  of  social  desix- 
ablllty,  there  has  been  a  great  deal  of  renewed  Intezmst  in 
the  Inventory  technique. 
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On  the  positive  side  of  the  ledger,  the  personality 
Inventory  may  be  thovight  of  as  a  formalized  intervlev  with 
the  great  practical  advantages  of  objectivity  and  standard¬ 
ization,  lov  cost  per  individual  casei  ease  of  scoring  and 
administration,  and  relatively  lov  demands  on  the  time  of 
both  subjects  and  highly  trained  personnel.  In  spite  of  all 
of  the  problems  In  obtaining  satisfactory  predictive  valid¬ 
ity,  many  studies  show  a  moderate  level  of  validity  for  In¬ 
ventories  In  differentiating  between  various  groups.  Also, 
there  Is  plentiful  evidence  which  Indicates  the  existence  of 
consistencies  In  human  behavior  which  may  be  susceptible  to 
measurement  of  the  inventory  type.  FlneiUy,  It  Is  clear 
that  Individual  attention  Is  a  luxury,  sued  that  large  scale 
military,  Industrleil,  aiad  school  programs  will  continue  to 
demand  some  personality  assessment  at  least  at  the  screening 
level,  using  paper  and  pencil  inventory  technlq.ues.  Thus, 

It  appears  that  a  place  for  such  techniques  is  assured,  and 
that  the  need  is  to  refine  and  improve  such  techniques  to 
provide  more  valid  results.  Efforts  at  such  improvements 
are  currently  being  made  In  many  directions.  Refinements  In 
technique  and 'theory  such  as  those  discussed  earlier,  coupled 
with  a  re-exaailnstlon  of  vEd.ldatlon  proeeduxesn  and  continu¬ 
ing  search  for  new  and  more  appropriate  validity  criteria, 
appear  to  hold  considerable  promise  of  progress  In  this  area. 

Beablirtlcai^.of  the  Prohlea 

In  measuring  personality  in  the  present  study,  the  re- 
cixmwndations  of  the  testing  Bansl  and  the  conclusions  sug* 
Costed  by  historical  and  developmental  considerations  were 
adapted  to  the  specific  requirements  of  the  problem  at  hand. 

Thus,  the  present  study  enq>loyed  personality  measures 
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idilch  vere  essentially  self -administering,  not  very  time  con¬ 
suming «  and  adaptable  to  machine  scoring  and  conqputer  analy¬ 
sis.  In  general  then  the  test  vas  to  be  one  \dilch  fairly  re¬ 
presented  the  "state-of-the-azi:'*  in  assessing  the  personality 
of  normal  individuals,  yet  was  tailored  to  the  needs  and  pur¬ 
poses  of  the  project. 

■  Purpose  of  the  Test 

In  addition  to  possible  contributions  to  measurement 
techniques  and  knowledge  about  personality  in  genersil,  the 
personality  Inventory  vas  intended  to  provide  information 
beefing  on  the  several  project  goals.  Examples  of  possible 
uses  of  the  personality  inventory  information  included  the 
study  of:  1.  any  relationship  between  high  school  policies, 
conditions,  etc.,  euad  personality  variables;  if  enrich¬ 

ment  produces  better  college  grades,  is  this  equally  so  for 
those  with  equal  ability  but  different  personality  patterns; 

2.  similarly,  the  effect  of  college  policies  and  practices; 

3.  relationship  of  personality  variables  to  the  other  factors 
which  determine  the  effective  utilization  of  the  national  po¬ 
tential;  4.  college  auad  career  plans  by  personality  trait, 

,  do  highly  dominant  people  plan  careers  as  executives 
more  often  than  less  dominant  people;  personality  traits 
as  related  to  declsion-madElng;  to  levels  of  aspirations,  etc. 

It  should  be  noted  that  the  Project  Talent  test  made  no 
attempt  to  measure  ahnozvslties  or  psychiatric  problenus.  On 
the  contrary,  it  was  intended  to  be  used  only  with  normal 
individuals  in  an  effort  to  provide  additional  inforaation 
about  the  way  that  people  use  their  talents  and  abilities. 

In  designing  the  test,  one  point  to  be  considered  was 
the  type  of  the  test  to  be  used.  Of  covrse,  it  had,  to  be 


multl-dlmenslonal,  Isut  should  It  be  a  collection  of  unl- 
diaensional  tests  (\ihere  each  Item  is  scored  for  Just  one 
scale),  or  should  it  be  of  the  Bemreuter  typet  The  latter 
type  is  more  efficient  since  several  scores  may  be  gotten 
fraa.  the  same  set  of  items  using  different  vei{^ts  for  the 
items  in  different  scores.  This  efficiency  is  somevhat 
offset  however,  but  the  feict  that  the  scores  obtained  from 
such  a  test  may  show  some  interrelationships  which  are  arti¬ 
ficial;  that  is,  they  come  from  the  fact  that  the  same  items 
are  scored  for  different  traits,  not  necessarily  from  the 
interrelationships  of  the  traits  themsilv-ii^ . 

Flanagan  (l935e>193^)  ^s  shown  that  such  artificial 
relationships  are  often  of  little  Importance,  and  that  stat¬ 
istical  corrections  can  be  applied  to  eliminate  themselves . 
Nevertheless  they  Introduce  complications,  and  it  was  decided, 
to  score  each  item  for  Just  one  trait. 

Measurement  Approach 

It  is  commonly  agreed  among  most  investigators  that 
there  are  at  least  several  reasons  for  the  limited  successes 
attained  in  the  field  of  personality  measurement.  APK^ng 
these  are:  l)  the  ineu:cesslbillty  (within  the  person^ of 
the  basic  determiners  of  behaviors,  thus  requiring  indirect 
measurement  and  inference;  2)  the  apparent  complexity  of  the 
detexmlnatlon  of  any  bit  of  behavior,  involving  the  inter¬ 
action  of  many  needs,  vast  fuzvis  of  personal  experience,  and 
constantly  changing  external  conditions;  and  3)  the  fact 
that  various  conditions  often  result  in  similar  bahavlor, 
and,  conversely,  that  similar  conditions  often  give  rise  to 
vastly  different  observable  behaviors. 


Under  such  conditions^  the  trait  approach,  idxile  des** 
eriptive  of  hdMvior ^  may  often  yield  a  surface  type  of  neas- 
ureiMnt,  Imping  together  (or  sepazating)  hsduYiors  arising 
frcB  vastly  different  (pr  hli^ily  slMilar)  internal,  notiva- 
tional  conditions.  On  the  other  hand,  the  factor  analytic 
approach,  vhile  it  may  introduce  a  condensation  of  data,  may 
also  Imp  together  a  great  variety  of  constructs,  dynamically 
different  in  origin.  In  addition,  it  is  often  difficult  to 
translate  factor  analytic  data  into  xellahle  axid  real  beha¬ 
vioral  terms. 

In  view  of  the  limitations  of  both  of  these  approaches 
it  vae  decided  to  coaibine  some  of  the  features  of  both  the 
factor  analytic  and  the  trait  approaches.  In  brief,  previous 
vorh  plus  careful  rational  analysis  formed  the  foundation 
for  defining  a  number  of  narrow,  but  relatively  pure,  aspects 
of  high  school  behavior.  These  were  not  designed  to  cover 
«dl  high  school  behavior,  but  to  sasq^le  selectively  at  points 
well  distributed  throuf^ut  the  range  of  high  school  behavior. 
This  procedure  was  designed  to  result  in  relatively  good 
measurement  of  such  narrow  traits.  Aasumlng  that  the  vinder- 
lylng  broad  factors  of  personality  consist  of  highly  inter¬ 
related  aspects  of  personality,  and  that  the  defined  narrow 
traits  represent  some  of  many  such  aspects,  it  then  appears 
reasonable  that  measurements  or  selected  combinations  of 
measurements  of  such  narrow  traits  diould  be  quite  well  re¬ 
lated  to  the  brood  factor  e(»eezned. 

In  the  narrow  trait  approach  it  is  important  that 

these  nazTOW  traits  sample  liich  of  the  important  aspects  of 
normal  high  school  behavior  Of  a  personality  nature.  Several 


steps  were  taken  to  insure  such  coverage: 

A.  Criteria.  larrov  traits  vere  derived  frosl  a  con¬ 
sideration  of  high  school  hehaviorB  according  to  sevezml  cri- 

i 

teria. 

1. ,  The  behavior  occurs  in  school  and  is  observ¬ 
able. 

2;  It  can  be  vell-enou|^  defined  to  be  identified  by 
a  hiifh  school  student. 

3. It  is  reasonsble  to  expect  a  high  school  student 
to  be  able  to  rate  hlnself  otf  this  behavior. 

4  The  b^vior  can  be  expected  to  be  laportantlgr^Ye- 
lated  to  future  behavior. 

There  are  many  iaportant  aopeots  of  nonMl  behavior 
vhloh  vere  ellainated  aoeording  to  one  or  nere  of  these 
criteria  as  being  Isso  than  wairlaaniy  important  for  this 
study. 

B.  froaedura.  Based  upon  literature  revlevi  psyoho- 
logioal  analysisi  and  the  applieation  of  the  above  oriterig, 
a  set  of  nanrpr  ta^ts  vas  defined.  It  eas  felt  that  the 
essenoe  of  the  aarrov  trait  approa^  lay  la  the  aalaatiOB 

I 

of  aoveral  behayieral  adjeotivea  ehiah  would  define  the 
beha^er  ladlaated  by  the  trait,  leveral  anrodehea  to 
the  Nleotlea  of  auah  behavioral  deaarlytleas  were  aigieyed. 

1.  IiSJAML  iMiXIil'  ^  iaveatliatera 
ladependently  net  dewa  a  series  of  aarrew  tmltii  deflaed 
by  deaerlptlve  b*avleral  adjeetlvasi  derltii  fNi  thirii- 
lag  aheut  whet  thigr  Md  their  on  hltfi  aeheel  ae«ialatMees 
had  beea  llhs  .  Oeaaral  epwanat  aHiB  these  throe  la- 

t 

depeadeat  sets  of  aerrev  traits  was  aurpnalagSy  good. 
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2 .  }  M-ldctlY^T  An^iyaia.  xhe  entire  domain  of  effect¬ 
ive  bdiavloraL  adjectives  was  examined  using  Roget's  !naa«uMmis 
u  a  source.  The  above  criteria  were  applied  to  2000  adject¬ 
ives  and  the  remaining  200  words  categorised  into  a  system 

of  narrow  traits.  To  Insure  complete  coverage  a  sample 
of  Allport  and  Odhert's  (193^)  exhaustive  list  of  17>9^3 
trait  names  was  examined.  Correspondence  "between  the  Ro- 
get  and  Allport  coverage  was  g-'id.  The  adjectival  cate¬ 
gories  also  agreed  well  with  tl.>^se  devised  earlier. 

3.  Relationship  between  Harrow  Trsd.ts  ajad  Broad.  HiAh- 

er-order  Factors.  In  order  to  provide  some  tie-in  factor  r. 
studies^  reviews  of  the  literature  were  studied^  including 
French's  (1953)  critique.  Such  reviews  provided  information 
through  which  the  narrow  traits  were  logicall;*  related  to  the 
major  second-order  factors  found  most  consistently  in  more 
than  70  studies.  These  six  feu: tors  were:  Dominance ^ 

.  Sociability,  .  Drive,  .  Self-Sufficiency,  Masculinity, 
and  .  Mature  Fersonality. 

The  neurrow  traits  derived  through  the  processes  described 
above  cover  many  of  the  aspects  of  behavior  formerly  classi¬ 
fied  under  one  or  another  of  the  six  higdier-order  feuitors, 
emd  at  least  some  of  the  aspects  of  behavior  from  each  of 
them.  Moreover,  the  behaviors  falling  under  them  are  more 
clear-cut,  more  easily  definable  and  easier  to  measvire  by 
self-rating  on  the  hi^  school  level.  Some  of  the  traits  are 
more  closely  related  to  some  of  the  higher-order  factozp 
than  others,  but  most  are  related  to  One  or  another  of  the 
six. 

C.  Narrow  Traits  Tried  Out.  Consideration  of  all  of 
the  available  materials,  lists  and  background  led  to  certain 
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recommendatlonB  for  traits  to  be  measured. 

7he  scales  listed  In  Table  VIII-2  below  Included  all  of 
those  prepared  for  the  tryout  of  the  preliminary  form  of  the 
test.  A  number  of  these  were  omitted  from  the  final  form  on 
the  basis  of  tryout  results,  limitations  of  testing  time,  or 
booklet  space.  A  description  of  each  scale  may  be  found  In 
Appendix  8a. 

Table  VIII-2 

SAI  Preliminary  Tryout  Scales 


Leadership 

Vigor 

Productivity 

Tidiness 

Sociability 

Self-Confidence 

Cheerfulness 

Culture 

Talkativeness 


Iii5>ul8iveness 

Persistence 

Calmness 

Social  Adjustment 
Theoreticality 
Responsibility 
Social  Sensitivity 
Group-Centeredness 
C  onvent  ioneil  1  sm 


.  .  Format  of  the  Experimental  Test.  The  preliminary 
form  of  the  personality  test  had  about  15  to  20  items  for 
each  of  the  l8  scales  tried  out.  It  was  anticipated  that 
tryout  data  would  make  it  possible  to  come  out  with  about 
10  scales  of  about  15  Items  each  for  the  final  form. 

The  test  was  divided  into  several  parts.  Parts  I  emd  II 
were  short  statement  items  concerning  "Vhat  I  do  and  the  way 
I  do  It."  Peurt  I  contained  Items  best  answered  by  options 
describing  how  often  a  statement  was  true,  and  Part  II  con¬ 


tained  items  best  answered  by  how  well  the  statement 
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described  the  student.  Of  course,  many  Items  fitted  In 
either  peurt  and  these  vere  simply  placed  In  either  part 


« 


* 

m 


Sample  Fonnat: 


Regarding  the  things  I  do  and  the  vay  I  do  them, 
this  statement  describes  me 


A.  extrdmely  veil. 

B.  quite  veil. 

C.  fairly  veil. 

D.  not  so  veil. 


^almost  c^.vays^) 
(often. ) 

(about  half  the  time,) 
(not  very  often.) 


E.  poorly  or  not  at  all.  (almost  never.) 

Item  1.  I  have  plcuoned  my  ovn  future. 

Item  2.  I  like  to  be  by  myself. 

Part  III  consisted  of  statements  about  ”Hov  other  people 
describe  me,"  i,.e^.,  "Regarding  the  things  I  do  and  the  vay  I 
do  them,  this  statement  describes  vhat  other  people  say  about 
me."  etc.  Part  IV  consisted  of  a  number  of  vords,  rather 
than  statements,  "that  describe  me".  Part  V  also  consisted 
of  "Words  that  describe  me",  given  In  the  same  form  as  Part 
III  (vords  other  people  vould  use).  There  vere  a  total  of 
300  Items  In  the  experimental  form. 

.  The  Administration  of  the  Experimental  Test,  Fall 
1959 •  The  experimental  form  of  the  test  vas  given  to  several 
groups,  each  of  vhlch  had  taken  a  vell*knovn  personality 
test  previously.  In  this  vay.  It  vas  possible  to  get  Item 
analysis  data  and  to  estimate  the  relationships  of  the  ex¬ 
perimental  scales  with  other  tests  at  the  samd  time.  The 
details  of  this  tryout  are  presented  more  fully  in  Appendix 


an. 


The  Final  Form.  On  the  basis  of  the  tryout  data, 
several  scales  vere  osiltted,  numerous  items  dropped, and  some 
scales  cooiblned.  This  resulted  in  a  final  form  of  1^0  Items 
emd  13  scedes. 


I 
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It  is  not  expected  that  the  13  scales  scored  in  the 
final  form  will  cover  the  full  range  of  high  school  person¬ 
ality.  They  represent,  rather,  the  best-measured  of  the 
initied  group  of  scales.  However,  efforts  will  be  made  to 
retain  the  much  broader  coverage  of  the  I50  individual  items 
themselves,  if  feasible,  to  relate  to  student  behavior. . 

Thus  it  is  planned  not  to  rely  solely  on  the  scale  scores 
in  this  area. 

The  13  scales  scored  in  the  final  form  are  shown,  along 

'  ) 

with  the  combinations  -vdiich  were  made  in  Table  VIII-3. 

Table  VIII-3 


Scales  Scored,  SAI  Final  Form 


Scale 

Nui|i!l>er^of 

It^s 

Experimental  Scale 
from  Which  Derived 

1.  Sociability 

12 

Sociability  and 
Cheerfulness 

2.  Social  Sensitivity 

9 

Social  Sensitivity 

3-  Impulsiveness 

9 

Impulsiveness 

U.  Vigor 

7 

Vigor 

5.  Calmness 

9 

Calmness 

6.  Tidiness 

11 

Tidiness 

7.  Culture 

10 

Culture 

8.  Leadership 

5 

Leadership 

9.  Self-Confidence 

12 

Self-Confidence 

10,  Mature  Personality 

2k 

Productivity,  Persistence 
and  Responsibility 

11.  Conventionality 

7 

Convent ional Ity 

12.  Theoretlcallty 

8  . 

Theoreticality 

13.  Group -Centere^ess 

6 

Group -Cent erednes  s 

Unscored 

21 

All  scales 

.  But  2.  XnrfAtory 


Kh&t  If  Aa  Itttercitt 

Boaetlaes  aade 

Saflaltloflui  of '  "latormt "  am  ^  toTM  of 

aaoust  of  Inf oxnAtlon  MtAiaod  In  glvon  lubjoet  rnttor 
•xoM  (ma  tb»  liifonAtionllAst;  and  la  tomi  of 

ovort  AotlTltlAf  (too tbs  atudtnt  lafoMAtlon  HABki 
Ob—only  ufod  InttMtt  Invoatorlef  dtfint  "IntiMAt}"  la 
toni  of  A^QMfMd  liking, or  pMfoMaoA  for  irarloui  ooou- 
patloni/ ■  AOtlrltlASi  aohool  Aubjoeti;  typtf  of  paoplti 
■oolAl  iltuAtloai^  oto.  Tbli  li  tho  daflaltloa  of ’^lattrAit" 
latoadtd  Jmm. 

Murloral  loloatliti  bnrt  OQtaMlMd  MMuriMBt  aad 

•MlUAtlOB  BBd'taBM  BBAlyitd  iBtAMBtl  1b  fOltt  tOM  ditBtli 

iSMy  Agrot  that  latoMit  lapllti  aDtltBtlea-ithBt  if  I  •» 
iBtamtod  Z  vUl  vast  to  do  aiuathlng  (aBtlvttiaa)i  vtU 
hiiri  doM  acMtlilBgf  of  vill  tevo  laanwd  aagatkiat  (tB« 
fonatiOB  or  tooMaiy). 

ftontaad  latamti  an  «  partOB'a  evlBieu  of  llMalf 
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as  contrasted  with  interests  measured  objectively  by  in- 
foraation  and  ly  reports  of  overt  activity j  Interests  are 
not  verifiable  or  observable  by  an  outside  agent.  Expressed 
Interests  may  be  said  to  be  general,  subjective.  Inclinations 
of  the  individual  tosard  certain  kinds  of  activities  and  ex* 
periences.  .^e  specific  activities  and  experiences  Included 
in  the  Project  ^Talent  Inventory  are  those  familiar’  to  high 
school  s-budents,  i.e.,  occupations,  school  subjects,  and 
activities. 

.Expressed  Interests,  attltudeai,  and  personality  items 
shaire  the  charac-berlstic  that  they  reflect  the  feelings  and 
motivations  of  the  individual  rather  than  demonstrate  his 
knowledge  or  display  his  experiences.  .On  the  other  hand. 
Interests, .  attltxxdes,  .  and  personality  items  differ  with 
respect  to  the  object  of  the  evaluation.  .In  typical  peison- 
edlty  questionnaires,  the  object  of  evalmtlon  is  the  self. 
.Attitudes  are  evaluative  expreaslons  towaxrd  an  institution, 
organization,  concept,  or  gxioup  of  people.  Interests,  on 
the  other  hand,  deal  with  eval\xatlve  expressions  -bowsud 
occupations  euxd  activities. 

Some  cautions  in  the  Intexpretation  of  Intexrest  scores 
eu:e  in  order.  Expressed  Interests  should  not  be  confused 
with  ability  or  experience.  .Other  factors  being  equal,  the 
most  viseful  information  we  can  have  about  a  person  in  order 
to  tell  whether  or  not  he  is  likely  to  go  -bo  college,  or  IS 

f' 

likely  to  achieve  good  'grades  in  a  course  of  stvidy,  is  a 
measvus  of  his  ability  and  his  past  pez^Ormsac*  in  similar 
school  subjects.  Only  when  these  rsqaireiimits  are  satis¬ 
fied  may  we  turn  to  measvires  of  Interest  in  order  to  choose 
between  equally  attrsctive  aitersatlves,  such  as  tsdclng  eui 
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extra  course  In  science  vs.  eui  extra  course  In  literature. 
Expressed  Interests 

Expressed  Interests  have  been  measured  In  several  ways* 
nie  most  common  way  now  In  general  use  Involves  obtaining 
statements  about  likes  and  dislikes  on  topics  such  as  occu- 
patlonsj  activities,  hobbles,  types  of  people,  etc.  (such  as 
the  Strong  Vocational  Interest  Blemk) .  Ihe  other  method  asks 
the  person  to  Indicate  his  preference  among  severaO.  occupa¬ 
tions  or  cM2tlvltles.  Following  Is  an  example  of  the  first 
type  of  question  (like  vs.  dislike)  taken  from  the  Project 
Talent  interest  Inventory: 

Directions;  For  each  occupation  listed  below 
you  are  to  consider  whether  or  not  you  would  like 
that  kind  of  work . Mark  your  answers  as  follows: 

A.  I  wotild  like  this  very  much. 

B.  I  would  like  this  fairly  well. 

C.  ' Indifferent  or  don't  know  much  about  It. 

D.  I  would  dislike  this  a  little . 

E.  I  would  dislike  this  very  much. 

1.  Surgeon 

2.  ..Chemist 

3.  Civil  engineer 

4.  .Writer 

5.  Social  worker 

An  example  of  the  preference  question,  such  as  that 
vised  In  the  Kuder  Preference  Record  follows: 

Directions:  For  each  group  of  occupations  listed 
below  Indicate  the  one  you  would  -like  most,  and  the 
one  you  would  like  least: 

a.  JMsthematician 

b.  Msohinist 

c.  Dietitian 

In  the  first  exainple,  the  student  may  feel  that  he 
would  like  all  of  these  or  none  of  these,  and  he  may  Indi¬ 
cate  this  directly.  Direct  compeurison  can  be  made  of  the 
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relative  BtKngth  of  his  Interests  as  veil  as  how  this  in¬ 
terest  coiiq;)az*es  to  otiiers.  In  the  second  exastple,  he  oust 
make  a  choice  aisong  several  ocetgpatlons  even  though  he  SMy ' 
like  then  equally  veil  or  dislike  them  to  an  eq]ual  degree. 
Vor  the  Project  Talent  Interest  Inventory  ve  felt  that  more 
would  be  gained  by  using  the  llke-dlsllke  format.  It  would 
allow  us  to  describe  our  youth's  Interests  and  at  the  sasie 
time  give  us  information  on  the  nunber  of  boys  and  girls  in 
the  country  idio  are  interested  in  specific  occtqtatlons  Such 
M  idiysiclfuij  engineer,  carpenter,  farmer,  nuiaSi  ate. 

In  any  ease,  the  difference  between  the  like-dislike 
format  and  the  preference  format  for  describing  the  Indi¬ 
vidual's  Interests  seems  to  sake  little  practical  difference. 
Several  studies  suggest  that  the  two  formats  measure  much 
the  same  thing, .  provided  that  the  content  of  the  questions 
is  about  the  same.  Ihurstone  ('^7)  used  a  modified  paired 
congMurlson  format. in  which  the  student  was  told  to  indicate 
idiether  he  liked  both  occupations,  neither  one,  or  one  more 
than  the  other.  He  then  correlated  his  Inventory  with  the 
Kuder  Preference  Record.  He  obtained  high  correlations  be¬ 
tween  his  scales  euid  the  slmlleu:  Kuder  SceCLes.  Similar,  re- 
suits  were  obtained  for  the  Project  Talent  Interest  Inven¬ 
tory  and  the  Kuder  Scales*,  suggesting  that  the  inventories 
\ 

are  iseasurlng  snich  the  same  thing.  In  wmUng 

predlctioM  from  inventory  responses  to  a  criterion 
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(such  as  successful  conpletlon  of  apprenticeship  or  training) 

Perry  (1955)  found  that  the  preference  format  vas  better  t.ViAr^ 
the  llke-dlsllke  fonnat  but  the  difference  >  although  statistically 
reliable,  uas  snail. 

What  Are  the  Lpx>rtant  Features  of  an  Interest  Inventory! 

Lqportant  features  of  an^  Inventory  Include  the  directions, 
the  Item  format,  the  types  of  scores  provided,  and  the  content 
of  the  Inventory.  These  characteristics  of  the  Project  Talent 
Inventory  vlU  be  described  here. 

The  purpose  of  the  directions  to  the  Inventory  Is  to 
describe,  define,  and  clarify  the  task  and  the  context  In 
idilch  the  questions  axe  to  be  considered,  and  to  motivate  the 
Individual  to  answer  In  a  manner  which  truly  reflects  his 
feelings.  ,0h  the  Project  Talent  Interest  Inventory  the  stu¬ 
dent's  task  Is  to  indicate  the  degree  to  which  he  likes, 
dislikes,  or  Is  Indifferent  to  a  variety  of  occupations  and 
activities.  In  order  to  clarify  the  context  In  which  the 
questions  cure  to  be  considered,  he  Is  told  to  consider  only 
the  activity  Involved  In  the  occupations;  he  Is  not  to  con¬ 
sider  associated  factors  such  as  salcuy ,  social  standing, 
permanence  of  the  work,  training  or  education  needed,  etc . 
PartlciUar  ea^hasls  is  placed  upon  answering  In  terms  of  the 
degree  of  his  liking  or  disliking 'idie  activity  Involved. 

This  approach  .8ho\;ild  help  to  rule  out  considerations  extraneous 
to  his  true  interests. 

Item  fozaat  Ineluilss  ths  "stem",  and  the  "options". 

The  stem  asy  be  a  word,  phrase,  or  sentence,  which  describes 
the  occi^tlon  or  activity  to  which  the  student  Is  to  react. 

The  options  describe  the  choice  of  reactions.  In  this  case 
a  scale  of  llke-dlsllke. 
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In  the  Project  Talent  Interest  Invehtory  it^  stems 
were  presented  in  the  briefest,  simplest  form  possible.  We 
felt  that  statements,  prases,  or  conplefte  sentences  were 
unnecessary  If  the  same  content  could  be  contained  In  a 
single  word.  Brief  Items  would  be  less  lU&ely  to  pose  a 
residing  difflcvilty  problem  and  would  be  likely  to  consume 
less  reading  time,  on  the  average. 

For  each  Item,  the  student  was  asked  to  Indicate  the 
degree  to  which  he  wotild  like  or  dislike  the  occupation  or 
SMitlylty  on  the  following  seals: 

A.  I  wo\ild  like  this  very  much. 

B.  I  wotild  like  this  fairly  well. 

C.  Indifferent  or  don't  know  much  about  It. 

D.  I  wotdd  dislike  this  a  little. 

E.  I  would  dislike  this  very  much. 

Interest  inventories  are  usually  scored  by  adding  up 
responses  to  a  number  of  questions.  Two  types  of  scores 
are  now  commonly  provided.  The  first,  like  that  of  the 
Kuder  Preference  Record,  the  Ihurstone  Interest  Schedule, 
the  Project  Talent  Interest  Inventory  (e^qperimentsQ.),  and 
others,  provide  scores  on  logically  defined  sireas  Such  as 
science,  mechanics, . socicQ.  service, .  euid  other  educatloned 
suid  vocationally  related  areas.  The  scales  sure  also  enplr- 
ically  defined.;  Persons  scoring  hl£^  on  a  sceCLe  usually 
like  most  of  the  occupations  or  utlvltles  In  that  sceile; 
those  scoring  low  on  a  scale  usually  dislike  most  of  the 
IteBB  in  the  sesde. 

The  second  approach  to  interest  scales  is  the  occu- 
patlfHial  scale,  best  rspresented  by  the  Strong  Vocational 
Interest  Blank,  but  in  process  of  further  develoiinent  in 
the  Kuder  Preference  Record  Form  D,  euid  the  Hlnnesota 
Vocational  Interest  Test.  Occupational  scales  relate  the 
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Interests  of  the  student  to  those  of  persons  vtao  hare  re«* 
mined  In  an  oeoupatlon  for  a  period  of  years*  !Ehe  reason¬ 
ing  hehlnd  this  apparoaeh  is  as  foUevst  an  Indlrldual  is 
more  likely  to  he  satisfied  in  an  oeeapatien  if  his  Interests 
are  similar  to  those  of  persons  in  that  asme  field. 

Exaaqilss  of  liie  seales  provided  on  the  Strong  are!  Artist/ 
Architect/  Engineer/  Chemist/  Tamer/  Social  Science  Teacher/ 
etc*  Clark  (^^6)  has  been  developing  seales  for  technical 
and  skilled  trades  occupations  vlth  the  NlBnesota  Vocational 
Interest  Test.  Ter  the  Projeet  Talent  IntHrest  Iitrentory 
both  types  of  scores  vlll  be  developed  for  reaearch  purposes* 
What  Quldaace  Do  Interest  Inventory  Results  Provide? 

Infomatlon  on  the  prognostic  value  of  Interest  Inven¬ 
tories  has  been  accumulated  over  the  past  fifty  years  through 
many  research  studies*  The  findings  of  Ihese  studies  pro¬ 
vide  guidance  in  Interpreting  the  edneatienal  and  vocational 
significance  of  a  student^s  Interest  scores*  T^loally/ 
resoardh  Is  oriented  tovEud  some  significant  sad  measurable 
aspect  of  behavior.  For  exaaqplt/  studies  of  college  groups 
relate  interest  scores  to  matriculation/  choice  of  a  college 
mjor/  grade-point  average/  and  graduation  from  college. 
Studies  of  occupations  relate  interests  to  choice  of  voca¬ 
tion/  entry  Into  the  occupation/  longevity  In  the  occupa¬ 
tion  (but  not  necessarily  In  the  specific  position)/  success/ 
and  satisfaction  vlth  the  eork.  Military  studies  have  been 
concerned  largely  yd.iih  selection  and  classification  of 


officers  and  emllstMkl 
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Hoy  tha  Tal«at  Interaat  lancrwttOTy  hm  DeT»lej«d 

Ibt  lAl^rost  IiKmtory  km  laoluAed  lx  th«  projoet  to 
obtolx  Am  ttaio  otutaita  dlroot  •aqprfsslou  of  latorMt  lx 
oecupatloxs  axA  xetlTltlos  roprosoxtlag  a  bread  raxge  of 
fields^  ij«rtd>  adheol  nibjoets;  hobblos/  paatlxoa^  etc. 

We  felt  that  ax  Ixreiitory  nbltth  eererod  the  general 
area  of  aeeeyted  Ixatruxents  la  preseat  ttse>  such  as  the 
Koder  Prefereaee  Record  aad  the  Strong  Yeeatlwual  laterest 
Blanks^  should  be  Ixeluded  lx  order  that  further  tests  could 
be  Bade  of  their  yalxe  lx  oceupatlexal  axd  edacatlMial  pre<» 
dletlmi  axd  Ihelr  usefulxess  lx  guldaxee. 

The  Ixterest  Ixvextory  yeis  developed  by  caHtplllag  a 
large  auxber  of  Items  from  available  Ixterest  Inventories 
axd  the  Bureau  of  the  Census  list  of  occupations.  The  Items 
yore  grouped  axd  elasslflsd  by  Interest  areas>  such  as 
scientific^  Utexary^  clerical;  etc.;  and  then  reduced  to  a 
manageable  nuxber  by  discarding  repeated  Items.  An  eiqperl* 
mental  fozv  yas  developed  using  300  Items  out  of  those  orlgl«> 
nally  cosq^lled.  Scales  for  scoring  the  Inventory  vere 
developed  by  assigning  Items  to  one  of  sixteen  areas.  The 
Inventory  yas  tlm  administered  te  a  group  of  high  school  axd 
college  atudenta,  aome  of  vhem  had  taken  the  Strong  Vocational 
Intereat  Blank  or  the  Koder  Preference  Record.  Scores  Am 
the  Intereat  Inventory  mere  Intercorrelated  aaong  themselves 
axd  correlated  ylth  acorea  Am  the  Bider  Preference  Record 
axd  the  Strong  Toeatloaal  Intereat  Hank.  Ihe  results  shov  tiaat 
the  Interest  Inventory  mssutos  seiMndKat  the  saae  things  Bea> 
sured  by  the  Euder  and  Strong  (Appendix  8b).  The  Interest  Inven¬ 
tory  yas  reduced  to  20^  items  based  on  the  results  of  the  pilot 
study. 
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What  Do  We  JQiov  About  Interegta? 

Interests^  as  ve  stated  esurller>  aure  thouj^t  to  re* 
fleet  aa  Indlvldvial^s  notlratlon.  These  are  the  things  ve 
like  to  iOf  or  would  like  to  do>  glren  the  opportunity.  The 
assuB^tlon,  by  behavior  scientists  and  laynm  allke^  has  been 
that  measured  interests  viU  therefore  relate  to  educational 
and  vocational  outcomes.  Specifically,  if  our  son  or  daughter 
has  a  high  interest  in  scientific  or  mechanical  pursuits,  it 
Is  likely  that  he  will  do  well  in  those  courses  In  high  school 
and  college  (provided  he  has  the  ability)  and  pexhaps  receive 
a  degree  in  engineering  or  a  related  field.  Beyond  this  series 
of  events  in  the  person*s  educational  development  we  expect, 
too,  that  he  shovild  obtain  es^loyment  In  that  same  field,  or 
one  closely  related  to  Itj  that  he  should  remain  In  that  field 
of  vorkj  and  that  he  should  achieve  a  measure  of  success  and 
satisfaction  in  the  field,  indicated  by  advancenent,  superior 
income,  added  responsibility,  or  recognition  for  unusual  or 
creative  achievement.  (Stated  more  succinctly,  we  expect 
interests  to  relate  to  educational  and  vocational  outcosMs, 
including  entry,  success,  and  con^letion  of  a  related  col¬ 
lege  course  and  entry,  success,  and  satisfaction  with  the 
occupation. ) 

It  behooves  us  to  say,  however,  that  these  es^ctatlons 
have  not  yet  been  adequately  explored.  The  only  way  to  find 
out  whether  Interests  are  Ijqportaat  is  tram  re  search  studies 
which  relate  measured  interests  to  each  of  these  goals  or 
criteria  of  perfonnaee.  Some  research  erldence  is  available, 
enough  to  suggest  some  concliuions,  but  not  enough  for 


deflxiltlve  conclusions.  More  InfOzmatlon  will  be  developed 
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over  the  years  through  research  conducted  as  part  of  Project 
Talent. 

It  would  not  he  ftilr  to  inqply  fram  our  stateaent  shove 
that  results  of  Interest  Inventories  should  not  he  used^ 
slnply  because  exhaustive  experiaientatloa  has  not  been  done. 
When  Interpreted  cautiously  by  a  qualified  guidance  counselor 
In  conjunction  with  Information  on  aptitudes,  achievements# 
plans#  and  personal  background.  Interests  can  be  useful  for 
helping  students  to  gain  some  self-lnsl£^t  and  to  help  them 
plan  their  most  ImiSedlate  educational  and  vocational  ob¬ 
jectives.  Final  decisions  for  choices  must  rest  with  the 
student. 

Much  of  the  resesLTch  work  on  Interest  inventories  Is 
largely  of  academic  Interest  and  will  be  dealt  with  only 
briefly.  Some  studies  have  been  concerned  with  developing 
new  Inventorltsj  some  with  the  description  and  refinement 
of  Interests  through  the  development  of  Interest  scales; 
some  with  describing  concurrent  relationships  with  aptitude, 
achievement,  background,  and  personality  variables.  However, 
of  most  concern  is  what  Is  known  about  how  interests  relate 
to  the  educational  and  vocational  goals  and  criteria  men¬ 
tioned  earlier,  such  as  academic  achievement  in  high  school 
and  college,  successful  completion  of  college,  entry  into  an 
occupation,  and  success  in  that  occupation.  Studies  will  be 
discussed  in  tenos  of  significance  for  education  and  for  an 
occupation. 

Slmlflosn^  for  Iducatlaa 

interests  have  been  related  to  quality  grades  in 
courses,  choice  of  a  college  major,  and  successful  completion 


of  courses  of  study.  Not  the  least  of  these  studies  are 
those  conducted  by  the  armed  services  for  the  purpose  of 
selecting  the  most  promising  candidates  for  specialized 
training  courses. 

Green  (1952)  sunanarlzed  the  results  of  studies  relating 
Interests  to  8Chol€»tlc  achievement.  He  concl\;4ed  that 
Interest  scores  axe  not  good  predictors  of  academic  achieve¬ 
ment,  but  do  seem  to  have  a  marked  effect  on  whether  or  not 
a  eoxirse  of  study  is  completed.  His  conclusions  appear  to 
be  open  to  question. 

Strong  (19^5)  fotind  that  interests  measured  by  his 
scales  distinguished  between  dental  students  (l4l)  more  on 
the  basis  of  completion  of  the  course  than  on  scholarship. 

Of  those  with  high  interest  ratings  (A  or  B+)  92^  graduated; 
of  those  with  moderately  high  interest  ratings  (B  or  B-) 

67%  graduated;  of  those  with  low  ratings  (C)  only  255^ 
graduated.  The  only  difference  foxind  in  scholeurship  was 
that  those  with  the  lowest  rating  (C)  had  inferior  grades. 

Tupes  (1953)  found  no  relationship  to  grades  in  Air 
Force  Officer  Candidate  School  using  the  Strong  Vocational 
Interesi;  Blank,  Kuder  Preference,  and  Gullford-Schneiderman- 
Zlmmenuan  Interest  Survey. 

Several  studies  suggest  that  the  value  of  Interests 
for  predicting  scholarship  needs  to  be  explored  by  construc¬ 
ting  special  scales  for  this  purpose.  Rust  and  ^yem  (195^) 
found  that  the  Strong  Vocational  Interest  Blank  could  dis¬ 
tinguish  between  good  and  poor  scholarship  students  after 
previous  school  record  and  achievement  test  scores  had  been 
controlled  (l.e.,  under -achievers  vs.  over-achievers).  This 
was  done  by  constructing  a  new  scale  from  the  Strong 
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Vocational  Interest  Blank  items.  Stone  ('6o)^  too,  constructed 
a  special  key  from  the  Strong  Vocational  Interest  Blank  that 
predicted  (r  =  .6o)  shorthand  proficiency  scores  for  sya  ad¬ 
vanced  junior  college  shorthemd  course.  And  Tussing  (19^2) 
found  that  a  special  scale  constructed  from  the  Strong  pre¬ 
dicted  first  semester  college  grades  about  as  well  as  an 
achievement  test  (ACE,  r  =  ,42  vs.  .-39)  • 

On  oi-.he.r .  >4arid.j  Super- - (4'94l')rrey-ljfiwed-' SOTcn- reseTarcSi 

reports  which  related  the  scores  provided  on  the  Kuder  Pre¬ 
ference  Record  and  school  grades.  The  results  show  a  wide 
range  of  relationships  (r  =  .00  to  .60,  median  about  .30) 
depending  in  part  on  the  courses  studied.  Stronger  relation¬ 
ships  were  noted  for  scientific  than  for  non-scientific 
subjects , 

These  studies  point  up  two  reasons  for  cautious  inter¬ 
pretation  of  interest  scores  as  related  to  school  grades. 
First,  the  scales  that  are  available  may  not  be  fruitful 
for  this  purpose,  although  the  construction  of  special  scales 
may  bring  out  the  relationship.  This  suggests  that  basically 
interests  do  relate  to  scholastic  achievement,  but  that  the 
relationship  must  be  brought  ouf  by  cdmblfiln'g  tire  items  in 
a  way  that  differs  from  some  of  the  recently  accepted  scale 
scores'.  Second,.  ..the.  .impcirt^nce  and  size  of  the  relationship 
appears  to  depend  in  part  on  the  type  of  course.  This  might 
mean  that  the  amount  of  motivation  needed  varies  from  subject 
matter  to  subject  matter.  If  this  is  the  case,  it  would  be 
valuable  to  know  the  student's  reasons  for  taking  each  covirse. 
Is  it  a  course  required  for  graduation?  for  prepeuation  for 
college?  for  a  specific  vocational  objective?  If  the  coxirse 
was  an  elective,  was  it  taken  because  the  student  waa  really 


InteriCifli^  In  Itf  becatise  his  parents  thou^t  It  would  be 
usefu^f  Joecause  it  appears  to  be  an  easy  course?  or  perhaps 
]i)ecause  a  teaoher  suggested  it?  If  properly  Investigated, 
these  ;r6&sons  might  be  found  to  aodlfy  and  clarify  the  re¬ 
lationship  between  interests  and  scholarship. 

Ihe  queaticm  of  the  relationship  between  Interests  Euid 
completip^  of  a.  aP'Urse  of  study  deserves  additional  attention. 
Strong  (  ^55)  fowiod  that,  a  greater  proportion  of  dental  stu¬ 
dents  with  high  Interest  ratings  tended  to  complete  training. 
Bolanoyich  and  Gkiodiiian  (19H)  found  that  among  women .  in 
training  for  electriced.  engineering,  those  with  hi^er 
scientific  and  computational  interest,  and  with  low  persuasive 
Interest  on  the  Ktider  Preference  Record  tended  to  complete 
training.  Berdie  (l955)  found  that  the  Strong  VocationeLL 
Interest  Blank  predicted  the  area  in  which  college  students 
received  their  degree.  ;  Ihe  measure  was  administered  in  the 
freshman  year  and  followed  up  to  graduation.  In  a  more  re¬ 
cent  study  (Berdie,  i960)  found  that  college  gradmtes  from 
medicine,  law,  and  accounting  could  be  distinguished  from 
one,  another  from  their  Strong  Vocational  Interest  Blank 
scores  suid  profiles,  even  thotudi  the'  questionnaires  were 
completed  in  the  senior  yeeo:  of  high  school. 

On  the  other. hand,  research  conducted  by  the  Army  Air 
Corps  during  World  War  II  on  the  selection  of  candidates  for 
pilot  and  navigator  training  (Guilford,  19^7)  found  no  re¬ 
lationship  between  Interest  inventozy  scores  and  completion 
of  training.  However,  further  research  showed  that,  to  a 
degree.  Interests  are  relevant  to  completion  of  training. 

A  few  interest  questions  were  fo\md  to  aid  in  prediction  of 
the  criterion.  Since  World  War  II,  each  of  the  armed  services 
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has  fovind  some  Interest  questions  to'  be  useful  In  select- 
Ing  and  classifying  officers  and  enlisted  men  for  training 
in  seirvice  specialties  or  for  duty  uslgnments.  dark  (1936), 
in  particular,  shoved  that  interest  scales  constructed  spe¬ 
cifically  for  the  task,  distinguished  between  men  in  four 
Navy  rates.  These  results  should  again  point  to  the  need  for 
caution  in  interpreting  the  restilts  of  Interest  inventory 
scores . 

Now  where  does  guidance  and  counseling  fit  into  the 

picture  of  the  dlMction  of  interests?  Sarbin  and  Anderson 

(19^2)  found  that  k  group  of  men  and  women  who  had  requested 

occupational  coiuiseling  because  of  dissatisfaction  with 

their  field  (and  idio  were  diagiosed  by  the  counselor  as  being 

in  inappropriate  fields)  rarely  had  primary  Interest  patterns 

for  the  Jobs  they  were  in. 

on  the  Strong  Vocational  Interest  Blank/  And  Stem,  Lewis, 
and  Bever  (1958)  found  that  vocational  counseling  of  adults 

0 

resulted  In  modification  of  Interest  scores.  The  change  ap¬ 
peared  to  be  toward  more  reed-lstlc  choices. 

scores 

In  summary^  it  appears  that  interest/relate  to  scholastic 
achievement  and  completion  of  training  to  at  least  some  degree, 
but  that  new  sceiles  may  have  to  be  constructed  to  bring  put 
the  relationship.  Interest  scores  may  also  be  useful  in  identi¬ 
fying  persons  with  inappropriate  vocational  goals  and  guiding 
them  to  more  satisfying  positions . 

Two  possible  reasons  that  may  account  for  failure  to 
find  relationships  might  be  self -selection— persons  who  are 
not  Interested  do  not  enroll  in  the  course;  and  adminis¬ 
trative  selection— course  requirements  may  weed  out  those 
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Mibo  are  not  Intereeted* 
fllgnlfleance  for  an  Oecuipatlon 

if  Intereets  reveal  s<^thliis  of  the  Individual '0 
motivation  in  hlB  educational  pursuits,  they  should  also 
reveal  something  about  his  motivation  in  his  pursuit  of  a 
career.  Bducatlonal  and  vocational  objectives  presumably 
have  elements  in  common  in  the  sense  that  education  repre¬ 
sents  preparation  for  some  vocational  objective.  We  expect 
that  in  addition  to  his  education  a  person's  Interests 
should  lead  him  to  seeh  employment  in  a  field;  that  he  viU 
usually  stay  in  that  field;  and  that  he  should  achieve  scune 
meastire  of  success  and  satisfaction  in  the  field  as  indicated 
by  advancement,  superior  income,  greater  responsibility,  or 
recognition  for  outstanding  achievement. 

Most  of  \rtiat  we  know  about  interests  and  occupations 
at  the  present  time  has  to  do  with  the  "group  membership" 
and  satisfaction  criteria.  By  "group  membership"  we  mean 
that  an  Individual  has  entered  and  remained  in  the  occupation 
for  a  number  of  years .  Information  on  success  as  indicated 
by  advancement.  Income,  or  responsibility  is  scarce,  but 
should  become  available  as  results  from  Project  Talent 
acc\]mulate . 

Besults  to  date  Indicate  that  interests  do  play  a  part 
in  detezminlng  what  occupation  is  entered  and  \diether  or 
not  the  individual  will  remain  in  the  occupation*  Strong's 
reseu'ch  (  *^3)  comprises  the  major  work  done  in  this  area. 

His  ipproaoh  usually  Involved  measuring  interests  of  ooU^ 
students  and  thim  following  up  after  various  tine  periods 
to  find  out  what  occupations  they  had  entered.  Els  work 
showed  that  interests  do  indicate  the  occupation  in  which 
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the  person  is  likely  to  be  engaged.  The  higher  the  interest 
rating  the  greater  the  chance  that  the  individual  will  be 
enqployed  in  the  occupation  (1935) •  But  the  highest  rating 
did  not  necessarily  indicate  the  occupation  entered.  Quite 
often  if  the  occupation  entered  differed  from  the  first  or 
second  choice,  it  still  numbered  among  the  first  five  choices. 

To  illustrate,  in  one  study  Strong  (1953)  followed  up 
a  group  of  Stanford  University  freshmen  19  years  later  (1930- 
19^9) •  Of  those  \dio  had  expressed  a  choice  of  eui  occupation, 
6ljt  followed  that  choice.  This  amounted  to  38j6  of  the  total, 
group.  About  5056  of  the  total  group  were  in  an  occupation 
closely  related  to  their  first  choice.  Those  \dio  changed  to 
xmrelated  occupations  scored  lower  on  their  first  choice  on 
the  Strong  Vocational  Interest  Blank  than  did  those  who 
followed  their  choice. 

Can  Interests  be  used  successfully  in  industrial  se¬ 
lection?  The  answer  appears  to  be  in  the  affirmative. 
Bolanovich  (19W)  used  a  measure  of  interests  in  an  indus¬ 
trial  setting  to  select  for  employment  women  with  no  previous 
experience  in  factory  work.  By  constructing  a  special  scale 
for  the  purpose,  and  selecting  only  those  among  the  highest 
60^6,  the  company  was  able  to  reduce  a  high  rate  of  tiun-over 
by  about  50^6  in  the  first  two  months  of  employment. 

Now  what  of  interests  Emd  satisfaction  with  the  occu¬ 
pation?  Ihe  resvilts  seem  to  show  that  satisfewtion  with  the 
occupation  after  a  number  of  years  is  intimately  related  to 
staying  in  the  field  or  leaving  the  field.  Genersdly,  re¬ 
search  seems  to  show  that  about  80)(  of  employed  men  aire 
reMonably  well  satisfied  with  their  occupations  (Strang, 

1955#  Chapter  lO)  and  that  this  figure  varies  some^at  with 
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the  occupation  and  the  amount  of  freedom  in  the  occupation. 
Professional  men  (physicians,  corporation  presidents,  lawyers, 
educators,  and  authors)  are  most  often  well  satisfied;  office 
workers,  sales  managers,  and  scientists  are  less  satisfied; 
and  skilled  workmen  end  laborers  least  satisfied.  Thus>  for 
the  most  part,  the  men  in  an  occupation  after  a  number  of 
yeeurs  are  reasonably  well  satisfied  with  the  occupation. 

Since  most  of  the  men  are  satisfied,  relationships  between 
degree  of  interest  in  the  occupation  and  satisfaction  are 
small.  That  the  dissatisfied  tend  to  leave  the  field  is 
shown  in  Gustad's  (1959)  study  which  differentiated  among 
college  professors  \dio  remained  in  teaching  and  those  idio 
left  for  other  pursuits.  Those  who  left  were  more  often 
dissatisfied  with  the  work  and  the  sitmtion.  It  appears, 
then,  that  interests  may  lead  to  entry  into  an  occupation, 
but  that  dissatisfaction  may  result  in  leaving  the  occupation. 
Of  those  remaining,  there  is  then  relatively  little  differ- 
ence  in  their  satisfaction  or  Interest. 

Success  in  a  field  is  perhaps  even  more  difficult  to 
define  than  satisfaction.  However,  relative  income  has  some 
bearing  on  the  matter.  Strong  (19^5)  showed  that  a  life  in- 
sureuice  salesman  with.  A  ratings  on  his  scale  earns  more  than 
do  those  with  lower  ratings.  Unfortunately,  no  other  studies 
idiich  relate  interest  to  Income  or  any  other  criteria  of 
success  in  an  occupation  are  available.  It  may  be  that  the 
relationship  lll\istrated  here  would  be  relevant  only  for 
ssULesmen  since  ssLLesmen  are  most  often  paid  according  to 
their  production. 

In  summary.  Interests  appear  to  have  some  beeuring  on 
choice  of  and  progress  in  an  occupation,  but  the  evidence  is 
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still  scarce  for  many  occupations. 

niere  Is  much  more  to  be  said  about  Interests  euid 
their  Ifltportance  and  relevance  for  occupational  choice  and 
progress— too  much  to  be  Included  here.  For  greater  Insights 
Into  the  development,  meaning,  and  utility  of  Interest  In-^ 
ventorles,  see  the  references  cited. 
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TOC--5T 


Pbrt  j.  The  Student  InforaKtlon  SLathk 


What  Kinds  of  Infomatlon? 

The  Inforsaation  requested  from  the  boys  and  girls  in 
the  Student  Information  Blanh  included  questions  on  personal' 
experiences,  plans  for  the  future,  and  the  social-economic 
context  provided  by  the  family  suid  the  home.  The  purpose  in 
gathering  this  inforaation  is  to  e^lore  the  significance  of 

these  events  for  attaining  educational  and  occupational . 

goals.  The  significance  of  experience  and  background  is 
reoogrdzed  in  literature  as  veil  as  science.  Quotations 
such  as,  "What  is  past  is  prologue”,  "Just  as  the  tvlg  is 
bent,  the  tree's  Inclined",  and  "The  child  is  father  of  the 
man",  all  recognize  the  molding  force  of  our  past  experience. 
Prospective  employers  look  at  work  e3q;>erlence8  in  order  to 
decide  nibfm  to  employ.  Likewise,  professional  athletes 
and  Buslclans  are  drawn  from  the  raidu  of  amateurs .  Activ¬ 
ities  and  hobbles  pursued  In  our  youth  often  have  dramatic 
significance  for  our  later  educational  and  vocational  pursuits. 


But  wbat  of  opportunity!  Many  students,  were  they 
able  to  afford  It,  Bd.£^t  like  to  learn  hov  to  play  the 
saxophone,  or  to  go  to  college,  .^ere  is  little  question 
that  opportunl't^  to  gain  Isqportant  experiences  differs 
even  when  Interest  and  ability. are  present.  .One  of  the 
most  inportant  indications  of  differences  in  opportunity 
lies  with  the  family  and  home  background.  The  social  and 
economic  provision  that  parents  are  able  to  give  their 
children  molds  and  modifies  experiences  available  to  the 
child. ’ 

Plans  and  decisions  made  during  high  school  are  cm 
outgrowth  of  both  background  and  e?cperlence  as  well  as  a 
look  to  the  future.  This  information  provides  an  account 
of  the  student's  next  steps  toward  achievement  of  his  goc^s. 

Some  exanples  will  illustrate  questions  on  each  topic. 
Among  the  questions  on  personal  experiences  were  those 
ej^lorlng  hobbles,  sports,  reading,  study  habits,  work 
experiences, .cmd  the  like.  Among  the  plans  emd  decisions 
about  vhioh.  Information  was  requested  were  plans  for  col¬ 
lege,  for  an  occupation,  and  for  marriage.  Questions  on 
the  family  and  the  home  Included  infonsatlon  on  the  make-up 
of  the  family,  parents'  occupations  and  education,  financial 
situation,  activities,  and  the  like. 

.The  specific  purposes  for  ewking  questions  of  each 
type  also  differ  according  to  the  topic.  .Several  lll\is- 
tratlcos  will  clarify  thia  point.  Among  the  questlona  on 
personal  expeflencea  are  a  nuMber  idiich  ask  about  hobbies, 
activities,  sports,  organisations,  and  the  like.  The 
reasoning  behind  q]ae8tlons  of  this  type,  generally,  is  to 
find  out  how  the  student  spends  his  time.  More  specifically. 
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these  activities  reflect  a  student's  Interests  and  moti¬ 
vations  evskluated  In  terms  of  idiat  he  has  done  In  the  past 
(rather  than  idiat  he  lll^s) .  Research  studies  have  found, 
too,  that  the  number  and  type  of  austivltles  euid  organi¬ 
sations  In  which  an  Individual  has  participated  are  often 
related  to  his  choice  of  a  currlculvm  In  Mgh  school  or 
college,  his  success  In  college,  or  his  success  In  an  occu¬ 
pation.  Hhe  main  point,  then.  Is  that  the  activities  In 
^Ich  a  stvident  has  engaged  reflect  a  basic  aspect  of  his 
make-up,  and  that  from  a  knowledge  of  .these  activities  It 
Is  possible  to  predict,  to  some  degree,  his  success  In 
educational  and  occupational  endeavors. 

Pacts  about  the  student's  family  euad  home  are  useful 
for  quite  another  piirpose.  In  the  search  for  taJ.ent,  re¬ 
search  has  shown  that  many  well-qualified  high  school 
students  do  not  enter  college  becatise  their  families  are 
not  able  to  provide  them  with  needed  financial  support. 

, For  this  reason  questions  were  included  on  the  parents ' 
occux>atlons,  education,  euid  Income  level.  This  Information 
provides  guide  lines  for  determining  parents'  ability  to 
pay  for  college. 

Still  another  purpose  applies  to  a  student's  plans  for 
after  high  school.  Flans  are  a  reflection  of  the  indi¬ 
vidual's  past  and  his  prognosis  for  his  future.  Plsuis  may 
be  realistic  or  fantasy-bound;  they  may  be  easily  attained 
or  unattainable.  The  skilled  vocational  counselor,  taking 
Into  account  the  student's  ability,  scholastic  achievements. 
Interests,  activities,  family  background,  and  plans.  Is 
qualified  to  present  this  Infozinatlon  to  the  studait,  point 
out  inconsistencies,  and  help  him  develop  plans  and  goals 
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that  are  realistic  euid  attainable.  For  those  students  vho 
have  not  clearly  formulated  their  plans,  the  vocational 
counselor  can  offer  guidance  toward  a  reeLllstic  choice. 

What  Kinds  of  fiuestlons? 

Information  about  background  and  experience  of  this 
type  places  major  emphasis  (thoti^  not  exclusively)  upon 
questions  of  objective  fact.  This  enqjhasis  lies  in  contrast 
with  the  Interests  Inventory  which  asks  for  subjective  ex¬ 
pressions  of  liking  or  disliking.  Many  topics  are  Identical 
with  those  lised  In  Interest  Inventories,  such  as  hobbles, 
activities,  etc*  However,  here  the  student  Is  asked  to 
report  ;diat  he  has  done  rather  theui  what  he  likes  to  do. 

Another  way  of  viewing  the  objectivity  of  these 
questions  Is  to  say  that  they  co\xld  be  observed  and  verified 
by  another  person.  This  is  not  a  characteristic  of  sub¬ 
jective  reports.  Accxiracy  of  the  report  depends  primarily 
on  opportvinity  to  observe  the  event,  memory,  and  honesty  in 
reporting . 

Partlciilar  experiences  varying  as  widely  as  they  do, 
the  choices  (response  options)  provided  to  a  question  must 
exhaust  the  possibilities.  This  means  that  each  individual 
must  have  an  opportunity  to  respond  in  accordance  with  his 
own  experience. 

For  any  given  question,  each  choice  must  also  be  ex¬ 
clusive  of  the  other,  unless  instructions  speclficsOly 
allow  marking  several  choices.  Otherwise,  confusion  will 
surlse  as  to  idilch  choice  is  the  appropriate  one. 

%iestlon8  on  plans  and  decisions  are  not  objective  to 
the  same  degree  as  are  background  and  experiences.  That  is 
to  say  that  they  ewe  not  events  that  can  be  directly  observed 
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by  emother  person  *t  the  time  they  are  reported.  On  the 
other  hand,  the  execution  of  a  plan  of  aetlon  may  be  directly 
observed.  For  exanq^le,  if  a  student  says  that  he  plans  to 
attend  the  state  \mlverslty  in  the  coming  year,  the  execution 
of  this  plan  can  be  directly  observed  and  verified.  This 
characteristic  of  potential  verification  distinguishes  plans 
from  inventoried  interests  and  other  subjective  reports,  euad 
from  biographical  information  about  past  events . 

In  summaiy,  q.uestions  about  background  and  experience 
are  objective  euad  verifiable;  questions  on  plans  auad  deci¬ 
sions  are  potentially  verifiable.  They  are  distinguished 
from  subjective  reports  on  this  basis. 

Hov  is  This  Information  Used? 

Much  of  the  information  obtained  in  the  Student  In¬ 
formation  Bleink  (SIB)  is  to  be  studied  for  a  variety  of 
pairposes.  It  shotild  be  helpful  to  the  reader  to  \mderstand 
some  of  the  purposes  for  which  information  of  this  sort  is 
gathered.  Three  types  of  studies  that  will  be  considered, 
representing  divergent  purposes,  are  the  survey  staadv.  the 
developmental  study,  and  the  selection  study. 

The  survey  study  is  perhaps  the  most  widely  known  and 
understood  of  the  three  types,  laical  survey  studies  are 
those  conducted  by  the  U.S.  Bureau  of  the  Census,  public 
opinion  polls,  and  market  siurveys. 

The  primary  purpose  of  the  survey  study  is  to  determine 
the  present  status  of  the  topic  in  question.  For  exaaple, 
the  ir*S.  Bureau  of  the  Census  gathers  Infoxmtion  on  the 
population  in  the  country,  on  persons  employed  in  various 
occupations,  on  the  sige-breeikdown  of  the  population,  etc. 

If  several  similar  studies  are  conducted  at  different  times. 
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it  is  possible  to  study  time  trends  by  coioparing  earlier 
figures  with  later  figures.  One  such  coii^>arl8on  is  the 
pTOportion  of  adolescents  enrolled  in  hl£^  school  for  each 
ten -year  period  for  the  past  fifty  years.  CJoaqparisons  of 
this  sort  are  useful  for  evaluating  progress  or  decline 
over  the  yesurs. 

Develonmental  studies  focus  their  attention  more 
fully  on  the  individual  and  his  development  physically, 
socially,  psychologically,  or  economically.  In  a  study  of 
time  trends,  enqphasls  is  placed  upon  numbers  of  people 
falling  in  a  given  classification;  for  example,  the  number 
of  i>ersons  eB5)loyed  in  skilled  occupations.  . Emphasis  Is 
upon  the  classification  scheme  because  these  may  or  may  not 
be  the  same  persons  so  employed  ten  years  earlier.  In  a 
developmental  st\ady,  it  might  be  found  that  an  individual 
classified  in  the  skilled  occupations  at  one  time  might  be 
classified  as  a  foreman  or  manager  at  another  time.  The 
people  are  the  same  but  the  applicable  classification  has 
changed.  This  type  of  study  provides  better  information 
for  studying  individual  development  and  progress. 

Project  Talent  combines  features  of  the  survey  study 
and  the  developmental  study.  The  status  of  the  country 
with  respect  to  hxjman  resources  will  be  evaluated,  but 
periodic  follow-up  studies  td.ll  investigate  the  develop¬ 
ment  of  all  of  the  students  in  their  educational  and 
occupational  pursuits. 

Selection  studies  focus  attention  on  the  personnel 
requirements  of  an  organisation.  Studies  of  this  sort 
may  be  instituted  trtien  the  nianber  of  available  applicants 
is  larger  than  the  number  of  positions  to  be  filled.  Tests, 


questloxmalreB^  azid  inventories  are  enQloyed  on  the  basis  of 
their  ability  to  discriminate  among  those  vith  the  greatest 
probability  of  success  In  the  position.  FOr  exsaqple^  during 
World  War  II  the  Amy  Air  Forces  Instituted  a  program  to  select 
pilots,  navigators,  axid  bombardiers  from  amosig  the  many  appU- 
cants  for  training.  !Ehe  resxilt  vas  the  developaent  of  a  battery 
of  tests  and  questionnaires  that  Indicated  the  probability  of 
success  of  each  applicant*  Ibis  program  vas  highly  successful 
In  that  a  small  number  of  men  were  accepted  for  training,  but  a 
high  proportion  of  those  accepted  graduated.  Fomerly,  a  large 
nimiber  of  men  vere  accepted  for  training,  but  only  a  small  per* 
centage  graduated.  Ihe  savings  to  the  government  In  training 
costs  mounted  Into  mllUons  of  dollars,  not  to  mention  the  cru* 
cial  factors  of  time  and  feicllltles  In  a  military  operation. 
Selection  studies,  then,  serve  the  needs  of  an  organization. 

They  do  not  give  us  information  on  the  Individual  *8  developaent 
other  than  that  available  for  the  benefit  of  the  organization* 
Infomatlou  needed  by  an  organization  for  predicting  probable 
success  In  a  position  Is  usually  imich  narrower  than  that  needed 
to  understand  personal  growth  and  developaent. 

The  purposes  for  which  Information  Is  used  In  developmental 
and  selection  studies  are  prediction  and  diagnosis.  Prediction  Is 
based  on  statistical  data  ^Ich  show  the  probability  of  certain 
outcoiaes  which  correspoad  to  given  test  scores  or  questionnaire 
responses.  For  exas^e^  It  Is  known  that  the  probability  of 
attradlng  college  is  hl|^  idien  the  student**  ablU^  is  hl|^,  or 
idirai  his  fhther  Is  a  professional  mnn.  The  stndwit  mny  be  apprised 
of  his  chances  for  entering  college  on  the  basis  of  the  known 
probabilities.  In  a  selection  situation,  applicants  are  accepted 
or  rejected  on  the  basis  of  known  probabilities  of  success. 
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Diagnosis  IhtoItbs  IxuUTldbual  study  looking  towsord  correetlTS 
action.  In  praebleal  situations  tills  aust  often  bo  done  uhen 
Infomatlon  on  prObablU'l^'  of  success  Is  difficult  to  piredlet. 
In  so  far  as  possible,  the  skilled  diagnostician  uses  Infonea** 
tlon  on  probabilities  uhen  It  Is  aTallable.  However,  too 
often  sufficient  Infomatlon  Is  lacking  and  the  diagnostician 
must  rely  on  his  eaqperlence.  Insight >  and  Intuition  for 
predictions. 

What  Is  Mow  Khown? 

Present  knowledge  can  best  be  evaluated  by  considering 
the  significance  of  background,  e:Q>erlenceB,  and  plana  for 
educational  and  occupational  goals  separately.  Special 
mention,  will  be  made  of  the  many  research  studies  conducted 
by  the  military  services  for  the  purpose  of  selecting  and 
classifying  personnel  for  special  training  schools  and  duty- 
assignments. 

Before  proceeding  further,  the  reader  should  be 
cautioned  that  ds-ta  now  available  have  been  gathered  from 
many  research  studies  conducted  for  a  variety  of  purposes. 

Some  of  these  studies  have  been  conducted  on  a  small  scale 
-to  e^lore  new  research  areas.  Others  have  been  conducted 
on  a  larger  scale  but  for  11ml--. led  purposes.  Project  Talent 
alms  to  explore  and  Integrate  the  significant  beharlors 
uncovered  by  previous  research,  and  to  Investigate  their 
Importance  for  development  In  an  eduoatlou  or  an  occupation. 
Studies  now  available  can  provide  a  frasMWOx^  upon  which  to 
build  for  undsrstsndlBg  the  slgnlficmnem  of  badtground  and 
es^rlence  for  educational  and  occupational  goals.  How¬ 
ever,  more  definitive  answers  -to  the  cooqplex  set  of  be¬ 
haviors  Involved  In  entering  college,  choosing  a  major. 
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achieving  acceptable  grades,  graduating  from  college, 

entering  em  occupation,  and  progressing  in  the  occupation 

or  others  broadly  based 
cannot  be  answered  until  results  from  this  study/become 

available. 

Education  and  Occupations 

It  is  common  knowledge  that  the  amount  of  education 
one  has  relates  closely  to  the  occupation  entered.  /Oils 
reflects  both  occupational  requirements  for  college  ti«iin- 
Ing  and  a  series  of  choices  and  decisions  oriented  toward 
realizing  an  occupational  goal.  For  example,  if  a  young 
man  chooses  medicine  as  a  career,  the  medical  profession 
specifies  that  he  must  fulfill  certain  requirements,  the 
culmination  of  idilch  is  graduation  from  a  recognized 
medical  school  and  coziq>letlon  of  Internship  training.  The 
student  at  the  same  time  recognizes  that  in  order  to  achieve 
this  end  he  must  graduate  from  hle^  school,  college,  and 
amdlcal  school.  It  is  the  Joint  operation  of  requirements 
set  down  by  some  segment  of  society  (in  this  exaiiq>le,  the 
medical  profession)  suid  the  choices  and  decisions  of  Indl- 
▼iduals  \dio  are  cognizant  of  these  requirements,  that 
structure  the  close  relationship  of  ed\ication  and  an 
occupation. 

We  have  perhaps  overstated  the  case  in  presenting  an 
occupation  with  clear-cut  requirements.  In  many  business 
suid  managerial  occt^tlons  and  in  the  arts,  formal  college 
training  is  not  so  clearly  related.  Ronetheless,  the 
CMierallsatlon  appears  to  be  true  that  the  amount  of  edu¬ 
cation  one  has  delimits  the  occupation  one  can  enter. 

Studies  have  been  conducted  vhich  describe  this  situ¬ 
ation  more  exewtly.  One  study  (Havemann  and  West,  1952) 
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compared  the  occupations  entered  by  college  graduates  with 
the  occupations  of 

/those  lAo  had  not  graduated  from  college.  For  men,  50p  of 
the  gradvates  but  only  3/^  of  the  non-gradxiates  were  In 
professional  occupations;  of  the  graduates  and  only  ISI^ 
of  the  non-graduates  were  proprietors,  managers,  or  exec¬ 
utives;  lOft  of  the  graduates  and  12jt  of  the  non-graduates 
were  in  clerical  or  sales  fields ;  5$  of  the  graduates  and 
38^  of  the  non-gi*aduates  were  in  skilled,  semi-skilled,  and 
unskilled  work;  and  only  Ijt  of  the  graduates  but  of  the 
non-graduates  were  farmers  or  farm  workers.  IBils  study  ^ 
provides  a  good  illustration  of  the  relationship  of  edu¬ 
cation  to  an  occupation.  But  this  does  not  mean,  of  course, 
that  the  only  road  to  success  is  a  colle^^e  education.  For 
many  persons  this  will  be  true  but  for  others  it  will  not, 
Ihe  yo\u)g  man  with  good  potential  as  a  skilled  craftsman 
but  poor  potential  as  a  college  freshman,  would  be  111- 
eidvlsed  to  attend  college  8lii5>ly  because  college  graduates 
more  often  than  non-greiduates  enter  the  professions  or 
become  executives.  Other  in^rtant  characteristics  (that 
will  be  discussed  shortly)  that  are  also  typical  of  college 
graduates  are:  above  average  academic  ability  and  achieve¬ 
ment;  Interest  and  aspiration  for  an  occupation  for  which 
a  college  degree  is  necessary;  parents  \dio  want  their 
children  to  have  a  college  degree;  auid  willingness  on  the 
psurt  of  the  parents  to  provide  financial  support.  With 
these  reservations  in  Jxadging  the  appropriateness  of  college 
for  an  Individual  youth,  it  is  q^iite  clear  that  education 
acquired  amd  occupation  entered  are  intimately  related. 
Significance  for  Education 


We  seek  to  answer  questions  regarding  the  backgrounds. 
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experiences,  euod  plBns  vhlch  characterize  those  of  our  bcgrs 
and  girls  idio  quit  hlj^  school— idio  go  on.  to  college,  — idio 
do  veil  acadoBlcally  in  high  school  or  college^— or  idio 
continue  on  to  gpiaduate  or  professional  training^  Identifi¬ 
cation  of  these  students  must  he  aade  In  order  to  be  able 
to  provide  them  with  proper  g^dance. 

Still  a  probl«n  In  our  nation  Is  the  large  number  of 
our  youth  vho  do  not  conplete  high  school.  Most  states 
have  a  conpulsory  attendance  lav,  requiring  attendance  tm- 
tll  the  l6th  birthday.  .And  It  Is  at  this  point  that  an 
alarming  number  of  boys  and  girls  chooee  to  forego  receiving 
a  high  school  diploma.  A  number  of  research  workers  have 
been  concerned  with  this  problem  and  have  Investigated  the 
background  and  e:q>erlences  characteristic  of  boys  and  girls 
Tdio  have  voluntarily  dropped  out  of  high  school.  ,  One  study 
(Btresher,  195^)  conducted  In  Michigan  found  that  youths  \(ho 
dropped  out  of  hlgsh  school  could  be  described  as  follows : 
•they  had  failed  subjects  in  elementery  school;  they  were 
frequently  absent  from  class;  -they  had  low  scholastic  apti¬ 
tude;  and  they  were  often  disciplinary  problems.  Usually 
they  were  not  employed  outside  of  school,  did  not  participate 
In  extra-curricular  eujti-yltles,  and  genereaiy  had  no  feeling 
of  Identification  with  the  school. 

.Characteristics  uncovered  by  ano'ther  study  (Taylor, 

1955)  agree  essentially  with  -those  above  but  add  the 
following:  school  drop-outs  are  usually  older  than  their 
claaamatea,  have  less  ability,  are  less  veil  prepared  aimi- 
dsaleally,  and  come  frcmi  a  lov«r  socio-economic  backgrovmd. 

having  completed  high  school,  many  of  our  youth  go  on 
•to  college.  .The  proportion  in  attendance  appears  to  be 
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IncreMlng  continually^  current  estimates  l^elng  In  the 
nelgbborhood  of  Our  next  .q,tiestlon,  then,  is  idiat 

characteristics  dlstin^^sh  the  youths  Mibo  enter  college 
frcmi  those  ^o  do  ]K>t.  Several  survey  sttidles  (Berdle, 
l^ki  EPS,  1957;  Little,  19^8;  Stouf fer,  1959)  suggest  the 
foUoving:  Ei^  school  atudents  Mbo  go  on  to  college  are 
above  average  in  both  ability  and  scholastic  achievement. 
Economically,  their  families  are  not  necessarily  well-to- 
do,  but  are  less  often  in  the  lowest  economic  bracket. 
.Ksmlly  subsistence  comes  before  a  higher  education.  Back¬ 
ground  and  V8J.ue8  reflected  in  the  father's  occupation 
play  a  part.  I^rdle  (195^  notes  that  90^  of  the  students 
with  high  ability  whose  fathers  were  in  top-level  occupa¬ 
tions  planned  to  attend  college.  In  another  group  with 
the  same  level  of  abilily,  but  whose  fathers  were  factory 
laborers,  only  35l^  planned  to  attend  college.  Berdie  notes 
further  that  the  differences  favored  the  children  of  the 
fathers  with  higher-level  occupations  even  more  when  plans 
were  related  to  actual  attendance  at  college.  Some  of  the 
vinderlylng  values  associated  with  the  father's  occupation 
are  his  own  education,  the  parents'  views  on  the  Is^rtance 
of  a  college  education,  and  their  willingness  (as  well  sus 
ability)  to  provide  financial  support  for  their  children. 
.More  directly  for  the  student,  his  own  values  play  a  part. 
.Does  he  see  college  m  a  step  toward  success?  Is  he  very 
Interested  in  coUeget  fbr  idmit  reas<»isT  Social  con¬ 
siderations  play  a  part,  ire  his  friends  going  to  ooUeget 
Is  college  social  life  a  major  reason  for  going  to  ooUegg? 

Proximity  to  a  college  plays  a  role.  Bc^  and  girls 
^o  live  within  commuting  dlsteince  of  a  college  attend  in 
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larger  numbers  thaui  do  those  living  beyond  comnutlng  dis¬ 
tance.  This  affects  youth  living  in  rural  aread  arul  In 
regions  In  the  West  with  low  population  density. 

In  summary^  idiether  or  not  a  student  enters  college  is 
determined  by  a  large  number  of  variables^  among  vhloh  the 
most  Important  appear  to  be  his  ability^  his  scholastic 
aushlevementj  and  his  father's  occupation  euid  education. 

Entering  college  does  not,  of  coiirse,  guarantee 
greuiuation.  Witness  tlve  large  number  of  drop-outs  during 
the  freshman  yeeur.  Most  state  universities  are  required  by 
law  to  admit  resident  graduates  of  high  schools  in  the 
state.  As  a  result,  a  large  number  (as  many  as  30^)  of 
students  find  the  work  too  difficult,  re-examine  their 
goals,  and  drop  out  within  the  first  year.  Others  are 
dropped  for  academic  failure.  Approximate  figures  (Wolfle, 
195^)  Indicate  that  roughly  of  those  vho  enter  college 
continue  on  to  receive  the  degree.  About  one-third  to  one- 
half  of  those  who  do  not  gz^uate  leave  during  the  freshman 
year,  the  remainder  being  spread  over  the  next  three  years. 

While  at  college,  the  question  of  scholarship  Is 

important  to  both  the  individual  and  the  university. 

Private  colleges  smd  universities  often  select  their 

students  on  the  basis  of  academic  performance  In  high  school 

and  objective  tests  of  aceuiemlc  achievement.  State  unlver- 
have  frequently  been 

sltles^HDOMoai  prevented  by  law  from  selecting  famong 
applicants  within  the  state,  but  have  used  tests  and  hl{^ 
school  academic  standing  to  select  among  out-of-state  appli¬ 
cants.  Both  variables  arc  quite  often  used  for  advising 
students  on  their  choice  of  a  major  cotirse  of  study. 

Whether  ;for  selection  or  for  individual  guidance,  tests  of 
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acadfeaAc  achievement  and'  records  of  academic  peirformanee  in 
hliE^  school  nre  among  the  major  indicators  of  academic 
potential  in  college.  Again,  however.  Other  characteristics 
come  into  play,  nie  most  consistent  among  these  other 
variables  appears  to  be  a  set  of  motivational  character¬ 
istics  reflected  in  the  student's  habits  and  attitudes  to¬ 
ward  studying.  Habits  and  attitudes  toward  studying  are 
reflected  in  questions  such  as  the  following  taken  from  the 
SIB: 

"65.  I  do  a  little  more  than  the  course  requires." 

"66 .  I  make  sure  I  understsmd  idiat  I  am  to  do 
before  1  start  an  sisslgnment." 

Some  recent  research 

XMnaaaOOdBDQtRXX  appears  to  show  that  these  qualities 
of  study  methods,  effort,  and  attitudes  contribute  infor¬ 
mation  on  probable  achievement  in  college  beyond  that  pro¬ 
vided  by  tests  of  academic  achievement  (Brown  and  Boltzman, 
19^5>  MwiiamsssmwiaBwnp;  1956;  Ward,  19^9)  •  ^1b  infor¬ 
mation  should  be  considered  with  reservation  since  the 
number  of  stvidles  ^ich  have  investigated  the  Importance  of 
stxidy  habits  is  still  smeill  and  results  Ore  Inconclusive. 

A  host  of .  additional  background  and  e:qperlence  cbar- 
cuiterlstics  have  been  investigated  in  order  to  understeud 
vbiat,  other  than  ability  and  past  SMshievement,  contributes 
to  good  scholarship  in  college.  Surprisingly,  once  in 
coU^  the  education  and  occupation  of  the  porrats  moke 
little  difference  in  how  well  the  student  does  in  his 
coiuaes.  Other  characteristics  that  have  been  investigated 
in  limited  settings  are:  participation  in  hif^  school 
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activities;  participation  in  out-of -school  organizations; 
offices  held  in  orfi^uixizatlons ;  size  of  the  conmunlty  In  ^Ich 
they  reside;  order  of  birth  among  their  siblings;  being  an 
only  child;  etc.  Results  are  as  yet  too  inconclusive  to  af¬ 
ford  any  generalizations  concerning  this  material.  Probably 
of  much  greater  loqportance  than  any  of  these  background  and 
experience  characteristics  will  be  the  demands  and  competition 
afforded  by  the  university  the  student  attends  and  the  program 
of  study  ^diich  he  pursues.  Different  universities,  and  evan 
specific  schools  within  tmlverslties,  have  varying  standards 
for  scholastic  achievement.  Colleges  with  reputations  for 
high  standards  tend  to  draw  more  applications  from  su:eulemlcally 
4ualifled  students,  on  the  average.  Engineering  emd  science 
programs  are  usually  more  demanding  than  rnemy  other  programs 
in  the  same  university.  Complete  understanding  of  vdiy  stu¬ 
dents  of  equal  ability  ewihieve  different  quality  grades  will 
certainly  have  to  be  interpreted  in  the  light  of  the  university 
he  is  attending  and  his  program  of  study.  Each  may  exact  dif¬ 
ferent  motivational  demands  and  draw  students  of  vsnylng  beu:k- 
grounds  and  experiences. 

■  For  the  majority  of  college  stiidents,  receiving  the 
Bachelor's  degree  is  the  final  step  in  their  formal  edu¬ 
cation.  Others  choose  to  continue  for  a  post-greiduate  or 
professional  degree.  Who  are  these  people?  What  eu-e  they 
like?  What  are  their  alms  and  goals  in  seeking  advauiced 
tzmlnlng?  froa  tdiat  kinds  of  backgrounds  do  they  cease? 

These  are  sosw  of  the  questions  that  muat  be  inveatigpited 
if  we  are  to  learn  how  to  guide  toward  advanced  college 
training  those  of  our  youth  who  are  Interested  and  able  to 
master  the  work.  Unfortunately,  at  this  time  questions  are 
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more  plentiful  than  answers. 

As  with  college  training  generally,  the  nuaiber  of 
students  vbo  go  on  to  graduate  or  professional  training  Is 
Increulng  rapidly  over  the  years.  For  exaa^le,  the  nunher 
of  Doctor's  degrees  conferred  In  1911-1^  was  about  2>500; 

In  1931-35  about  13,500;  and  In  1946-50  about  21,000  (Wolfle, 
1954,  pp.  300-301).  Shese  figures  give  some  Indication  of 
the  supply  and  demand  for  advemced  specialized  training  at 
the  college  level.  The  figures  do  not,  of  course.  Indicate 
how  many  students  enter  advanced  training  and  terminate 
their  education  with  a  Master's  degree.  Nor  do  they  Indi¬ 
cate  how  many  enroll  and  subsequently  drop  out  without 
receiving  the  degree.  We  need  Information  that  will  help 
a  student  appraise  his  probable  success  or  failure  In 
graduate  or  professlonsiL  school  before  he  enrolls.  Those 
students  with  little  chance  of  success  could  be  so  advised, 
while  those  irtio  appear  to  have  the  necessary  qualifications 
could  be  encovirsiged  to  attend. 

What  has  research  xmcovered  so  far?  Ability  level 
mahes  a  difference,  but  not  as  much  as  mig^t  be  e]q>ected 
(Wblfle,  1943,  pp.  319-322).  Grade  ewhievement  while  in 
.  college  makes  a  greater  difference  (Gro]^r,  1959;  Bavemann 
and  West,  1952),  as  does  the  student's  purpose  In  seeking 
advsnced  training.  !!!he  purpose  Is  usually  to  gain  greater 
specialization  In  a  chosen  vocation.  .  Okie  study  (Gropper, 
1959)  found  background  differences  between  graduate  school 
students  and  candidates  for  professional  degrees.  Those 
attending  professional  schools  tend  to  make  their  decisions 
for  advanced  training  at  an  earlier  time  them  do  those  In 
graduate  school.  Ihey  appear  to  be  more  strongly  Influenced 
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by  parents  and  other  relatives,  eind  more  often  have  fathers 
TAiO  have  professional  degrees.  They  tend  to  receive  financial 
suppox*t  from  their  parents  rather  than  from  other  soiurces. 
Graduate  students  tend  to  mahe  their  decisions  to  attend 
graduate  school  at  a  later  time,  are  not  often  Influenced  by 
parents  or  other  relatives,  and  usually  obtain  financial 
support  through  asslstantshlps  and  fellowships,  they  often 
have  fathers  who  have  also  had  gred.uate  work.  About  28^ 
of  both  groups  entered  gradviate  study  after  being  away  from 
college  for  several  years. 

This  aiqpears  to  be  as  much  as  we  know  about  the  back¬ 
grounds  of  our  gz^duate  and  professional  students.  What  we 
need  Is  Information  on  the  habits  of  study,  reading,  and 
value  for  education  In  early  life  as  well  as  during  college. 
Prom  common  obseivation  we  would  expect  greiduate  and  pro¬ 
fessional  students  to  display  greater  active  interest  in 
scholarship  and  erudition  for  their  own  sake.  We  would 
expect  their  backgroxmds  to  encourage  and  value  an  education. 
Hiese  characteristics  have  not  yet  been  fully  e:q>lored. 
Significance  for  eui  Occupation 

Having  completed  one's  education,  attention  focuses  on 
occupational  endeavors.  What  occupation  shall  I  choose? 

Where  shall  I  apply  for  a  position?  Where  am  I  likely  to 
achieve  some  meeisure  of  success  euid  satisfaction?  What  am 
I  qualified  to  do  with  bqt  capabilities  and  education?  For 
some,  the  answer  Is  quite  clear.  They  have  obtained  college 
or  vocatioiuO.  training  that  qualified  them  for  a  specific 
occiqmtlon.  Others,  with  less  specialized  education  and 
training  must  still  choose  from  a  number  of  possible 
positions.  What  occupations  do  our  yovtng  people  enter? 
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How  successful  will  they  he  in  their  occupatloned  pursuits? 
What  -backgrounds  and  experiences  lead  to  entry  or  success  In 
one  or  another  occupation?  These  are  the  questions  that 
must  be  answered  In  order  to  be  able  to  guide  our  youth  to¬ 
ward  apparaprlate  occupational  goals. 

What  we  mean  by  "entry"  amd  "success"  In  an  occupation 
will  help  to  clarify  the  material  that  Is  to  follow.  Entry 
meauis  slsply  that  the  Individual  has  applied  and  has  been 
accepted  for  a  position  In  some  occupation.  He  may  have 
entered  the  occupation  as  a  result  of  careful  planning  and 
by  conscious  choice;  or  he  may  have  entered  the  occupation 
slnply  becavise  of  Immediately  available  opportunities ^ 
having  been  encouraged  to  apply  for  the  position  by  a  friend 
or  relative,  or  simply  to  support  himself.  Of  course 
people  enter  and  leave  a  number  of  positions  during  the 
course  of  their  careers;  however,  there  seem  to  be  rela¬ 
tively  few  who  move  from  one  major  occupational  group  to 
another  (l.e.,  from  professional  to  managerial  or  sales, 
etc.)  very  frequently.  This  criterion  of  entry  or  occupa¬ 
tional  group  membership,  as  It  has  been  called,  provides  a 
good  picture  of  the  kinds  of  people  xdio  are  In  different 
occupations  for  a  specified  time  period. 

Success  Is  a  bit  more  difficult  to  define  but  cem  be 
attacked  sensibly  If  we  specify  \diat  we  mean  by  success  In 
an  occupation.  Success  may  be  defined  objectively  and  sub¬ 
jectively.  One  way  of  defining  success  objectively  is  In 
texns  of  the  occupation  itself.  Oius,  physicians.  Scientists, 
writers,  and  most  professional  persons  may  be  regarded  as 
being  at  least  moderately  successful  by  virtue  of  the  fact 
that  they  occupy  a  position  high  on  the  occupational  ladder 


VIII-75 


In  a  congpetltlve  situation.  Tbis  is  also  true  for  many 
highly  skilled  occupations.  Obvio\isly,  this  is  the  same 
thing  that  we  referred  to  as  entry  or  occupational  group 
manbershlp. 

A  second  vay  of  defining  success  is  in  terms  of  in> 
come.  Prestunably> . a  man's  worth  in  an  occupation  is  re¬ 
flected  by  the  amount  he  earns.  Certainly^  many  other 
factors  play  a  pert  in  earnings;  however,  success  should 
be  at  least  in  part  reflected  in  earnings.  Current  evi¬ 
dence  seems  to  shov  that  this  is  true  in  some  occxqiatlons 
but  not  necessarily  in  others. 

.  Other  ways  of  defining  success  are  specific  to  some 
occupations.  These  include  the  attainment  of  supervisory 
responsibility,  piece-work  production,  articles  and  books 
written,  or  receipt  of  ayards  or  recognition  for  achieve¬ 
ment  . 

Subjective  definitions  Include  how  successful  a  man 
feels  he  has  been  con^>ared  to  his  fellow- workers,  and  how. 
successful  he  has  been  cos^ared  to  his  own  standards  and 
aspirations.  The  former  is  a  "group-oriented"  standard 
while  the  latter  is  a  personal  standard.  Some  work  has 
been  done  using  the  "group-oriented"  standard  or  self¬ 
rating,  but  to  this  writer's  knowledge,  no  work  has  been 
done  which  relates  ability  and  beuskground  chSLracterlstlcs 
to  the  personsLl  standard.  That  the  two  axe  different  ap¬ 
pears  to  be  quite  clear.  That  is,  a  person  may  feel  that 
he  has  done  well  camgpared  to  his  fellows,  but  may  not  feel 
satisfied  that  he  has  achieved  his  full  potential. 

The  well-known  merit-rating  is  a  common  way  of  defining 
success,  particularly  for  those  positions  for  which  no 
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concrete  form  of  production  or  output  Is  available.  In 
this  case  the  supervisor  or  superior  evaluates  the  individual 
on  the  quality  of  his  vork.  Ideeilly,  if  the  evaluation  is 
to  be  a  fair  one ^  the  supervisor  should  have  had  equal  oppor¬ 
tunity  to  observe  all  of  those  under  him;  he  should  approach 
his  task  analytically  and  objectively;  and  he  should  focus 
his  attention  on  those  aspects  of  the  vork  that  are  critical. 

Generally,  there  appear,  to  be  three  contexts  in  'trtiich 
studies  of  occupations  have  been  made.  Ihe  Bureau  of  the 
-  ■  Census  provides  information  each  decade  on  the  number  of 
persons  enqiloyed  in  variotis  occupations.  Although  viseful 
for  their  purpose,  this  material  does  not  very  often  relate 
occupations  to  background  characteristics  of  individuals. 
Those  background  characteristics  that  have  been  related  are 
sex,  age,  and  education.  The  only  "success"  characteristic 
that  has  been  related  to  occupation  is  annvial  income.  It 
should  be  quite  clear  frcan  one's  own  observation  that  these 
characteristics  are  highly  interrelated. 

A  second  group  of  studies  are  those  conducted  by  indi¬ 
vidual  conqianles,  organizations,  or  industries  for  the 
purpose  of  selecting  the  most  promising  einployment  appli¬ 
cants.  In  this  type  of  study,  personsd.  characteristics  are 
related  to  specific  suspects  of  the  work  indicative  of 
"success".  This  might  include  any  or  sevei^sd.  of  the 
success  characteristics  mentioned  earlier,  including 
supervisor's  ratings,  production  records,  or  amount  of 
time  with  the  company. 

A  third  group  might  best  be  called  "career-pattern" 
studies.  Hiis  type  emphasizes  the  individual's  progress  in 
an  occupation.  He  may  change  positions  or  occupations,  may 


be  promoted^  handle  greater  responsibilities,  etc.  What> 
ever  his  role  or  covirse  of  eustlon,  the  enqidiasls  is  on  lh> 
dividual  choice,  euitlon,  and  progress.  Another  vay  of 
viewing  this  type  of  stvidy  is  from  the  point  of  view  of 
hinnan  development.  The  individual's  progress  is  followed 
through  education,  an  occupation,  emd  retirement,  docu> 
mentlng  the  pattern  of  his  life  history  as  it  progresses. 

The  Bureau  of  the  Census  publishes  figures  on  the  re¬ 
lationship  of  occupations  to  age,  sex,  education,  and  in¬ 
come.  In  general,  these  data  show  that  as  people  grow 
older  they  progress  to  hi^er  positions  and  their  eao'nlngs 
Increase.  Those  of  us  with  more  education,  on  the  average, 
occupy  higher  positions  and  receive  more  Income  than  those 
with  less  education.  Focusing  ovir  attention  on  sex  alone, 
we  find  that  women  obtain  less  education  than  men,  are 
concentrated  in  different  occupations  (teaching,  nursing, 
secretarial  and  clerical  work,  etc.)  from  men,  and  receive 
less  Income,  on  the  average.  Of  course,  many  women  become 
housewives  and  are  not  Included  in  the  labor  narket.  The 
fact  that  they  may  be  well-trained  stenographers,  nurses, 
teachers,  or  even  scientists  is  not  shown  in  this  infor¬ 
mation. 

^e  Census  information  is  useful  to  a  limited  extent 
for  understeuidlng  occupational  growth,  but  it  leaves  many 
questions  unanswered.  For  example,  how  are  people  guided 
into  different  occupations?  Vhat  relationship  exists  be¬ 
tween  the  father's  occ\^tion  and  the  occ';^tlon  entered 
by  the  son  or  dau^^ter?  Or  do  American  pazents  stress 
bettering  one's  position  to  such  eui  extent  that  the  child's 
occupation  is  higher  on  the  occupational  ladder  than  was 
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the  father's?  How  is  the  economic  bracket  of  the  parents 
related  to  the  occupation  and  economic  brsicket  of  the 
children?  Parents  In  higher  Income  brackets  are  likely  to 
be  In  a  better  position  to  educate  their  children, . provide 
them  with  a  flnsinclal  base  that  sometimes  extends  Into  the 
married  years,  provide  aid  for  business  ventures.  Introduce 
them  to  friends  vho  may  provide  help  In  obtaining  a  desir¬ 
able  position,  etc.  Furthermore,  the  children  usually 
Inherit  the  parenteG.  estate,  thus  bettering  their  own 
financial  position.  Many  questions  of  this  type  will  have 
to  be  emswered  before  a  coiig>rehenslve  picture  can  be  ob¬ 
tained  of  the  variables  that  enter  Into  choice  of.sm 
occupation  and  resultant  Income  bracket. 

Havemann  and  West  (1952)  limited  their  study  to  col¬ 
lege  gradiiates .  They  too  found  that  age  euid  sex  medce  a 
difference  In  occupation  emd  Income,  but  they  went  on  to 
other  findings.  They  fovmd  that  married  men  earn  more 
money  than  do  single  men,  and  after  age  30  married  men 
with  two  or  more  children  earn  more  than  do  those  with  no 
children  or  with  one  child.  There  may  be  several  reasons 
for  these  findings.  The  first  that  mlg^t  occur  to  most  of 
us  Is  that  married  men,  partlcvilarly  those  with  several 
children,  have  a  greater  Incentive  to  work  hard  to  provide 
a  living  for  their  families.  A  different  answer  might  lie 
In  the  personedlty  and  o:^er  characteristics  of  men  who 
marry  and  those  lAo  do  not.  Perhaps  both  marriage  and 
financial  success  may  reflect  the  sociability,  drive,  and 
ambition  of  the  person,  nils  we  will  learn  later  idien  we 
use  the  marrled-not  married  criterion  for  "validation" 
type  studies .  Still  emother  possibility  lies  In  pay  and 
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promotion  considerations  carried  out  by  employers.  Married 
men  with  children  may  be  given  greater  consideration  for 
advancement  than  those  with  no  children  and  single  men. 

Another  approach  was  taken  by  Thorndike  and  Hagen  (1939) • 
They  followed  up  about  10,000  men  who  had  taken  the  Army 
Air  Corps  selection  tests  (for  pilot,  navigator,  and  bombar¬ 
dier  training)  dviring  World  War  II.  The  tests  Included 
measures  of  aptitude  smd  ability  specifically  designed  for 
the  purpose  of  selecting  Aviation  Cadets,  but  also  included 
a  large  number  of  background  questions  lncl\iding  (l)  family 
and  personal  background;  (2)  major  subject  in  college,  if 
they  attended;  (3)  success  with  different  school  subjects; 

(4)  participation  and  skill  in  sports;  (5)  other  activities; 
(6)  hobbles;  (t)  work  experiences;  and  (8)  reasons  for 
seeking  Aviation  Cadet  training.  Comparisons  were  made 
between  groups  of  men  \dio  had  entered  a  given  occupation 
with  the  entire  group  that  held  been  tested.  Comparisons 
of  this  sort  reveal  the  extent  to  which  accountants,  for 
exanrple,  differ  in  background  from  men  in  all  other  occu¬ 
pations  .  In  all,  over  100  questions  were  used  to  portray 
differences  among  the  men  in  the  occupations  studied, 
making  the  detailed  results  dlfficiilt  to  report.  Suffice 
it  to  say  that  almost  all  of  the  differences  made  sense. 

As  we  would  expect,  college  attendance  and  college  major 
accounted  for  the  largest  number  of  differences  among  the 
occupational  groups.  Ihis  is  simply  a  reflection  of  edu¬ 
cational  requirements  for  most  occupations.  Iteyond  these 
resvilts,  the  differences  sure  more  revealing,  m  most 
cases  the  background  characteristics  appeared  to  be  quite 
relevant  for  the  occupation  entered.  Some  exanqiles  will 


clarify  the  point.  Skilled  tradesmen  showed  a  history  of  re¬ 
latively  poor  academic  school  work,  but  took  shop  and  mechani¬ 
cal  drawing  courses  while  in  cchool.  Hobbies  e.nd  free -time 
activities  were  often  mechanical  in  nature.  Previous  work  ex¬ 
perience  before  entering  the  Air  Force  was  in  skilled  trades. 

Men  in  professional  occupations  usually  did  well  in  school, 
particitLarly  in  intellectual  courses.  Hobbies  and  activities 
were  not  often  of  a  mechanical  nature. 

These  authors  tried  relating  test  scores  and  background 
characteristics  to  income  for  the  men  in  each  occupation,  but 
without  success.  The  only  differences  in  income  that  were 
fo\md  covild  be  accounted  for  by  differences  in  the  occupations 
themselves .  This  means  that  average  income  differed  between 
accountants,  engineers,  and  teachers,  but  that  the  tests  and 
background  characteristics  did  not  distinguish  among  those  ac¬ 
countants  with  higher  or  lower  income  than  the  average. 

Studies  by  individual  companies  and  organizations  usually 
have,  the  purpose  of  selecting  from  among  a  number  of  job  appli¬ 
cants.  Tests  and  personal  background  information  often  indi¬ 
cate  the  most  promising  among  a  large  number  of  candidates.  In 
this  setting,  much  of  the  background  information  obtained  is 
requested  on  the  application  form.  Responses  to  questions  are 
scored  or  weighted,  giving  the  often  used  title,  "Weighted 
Application  Blank". 

The  first  use  of  weighted  and  keyed  application  blanks 
was  by  the  Life  Insurance  Agency  Management  Association.  Kelly 
(19^2)  developed  a  Biographical  Inventory  for  the  Committee  on 
Aviation  Psychology  of  the  National  Research  Council  using  funds 
supplied  by  the  Civil  Aeronautics  Administration.  This  inventory 
is  the  basis  for  special  forrnis  developed  by  the 
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Armed  Services  for  selection  and  assignment  of  men  to 
specialty  schools  and  duty  assignments.  Stvidles  conducted 
hy  the  Axmed  Services  will  be  discussed  In  the  next  section. 

Although  concerned  with  relative  degrees  of  success 
among  a  group  of  Job  appllceuits,  this  type  of  work  places 
less  emphasis  on  the  Individual  and  more  on  satisfying  the 
requirements  of  the  organization.  Fortunately,  the  needs 
of  the  Individual  and  the  requirements  of  the  company  are 
not  often  in  conflict.  However,  the  point  to  keep  in  mind 
Is  that  the  weighting  of  the  application  blank  for  b8u:k- 
ground  information  Is  based  on  the  company'-s  past  experience 
on  criteria  such  as  production,  seiles,  supervisory  ratings, 
length  of  service,  etc.  These  are  all  what  might  be  termed 
"orgsinlzation  specific”  criteria  In  that  they  may  be  appro¬ 
priate  to  one  company  but  not  necessarily  to  another. 

The  information  obtained  usually  parallels  the 
material  outlined  for  the  Thorndike  suid  Hagen  (1959)  study. 

In  many  cases,  greater  emphasis  is  placed  on  previous  work 
history  suid  previous  salary,  and  additional  questions  are 
asked  on  such  topics  as  proximity  to  the  company,  whether 
any  frlhnds  or  relatives  work  for  the  compeuiy,  and  the 
reasons  for  applying  to  this  compemy.  Moderate  success 
has  been  achieved  for  applicant  selection. 

Career  pattern  studies  focus  attention  on  the  indi¬ 
vidual's  choices  as  he  progresses  throu^  his  education 
sunid  occupation.  En^hetsis  is  upon  Individual  choice  and 
decision,  whether  rational  or  Irrational,  whether  well- 
or  Ill-conceived.  These  studies  attempt  to  account  for 
tlie  variables  Involved  in  choice  of  an  occupation,  ^estlons 
such  as  the  following  are  posed;  When  do  children  tend  to 
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choose  an  occupation  reeaistlcally?  Do  children  tend  to 
choose  their  father's  occupation?  What  Influences  decisions 
to  enter  an  occupation— or  to  leave  the  occupation  once 
having  entered?  Several  exnaqples  will  Illustrate  the  type 
of  results  that  have  been  obtained. 

Vocational  Interests  and  choices  by  hl^  school  stu¬ 
dents  below  the  Uth  greuie  have  been  found  to  be  tinreallstlc 
(Green,  1952,  Ch.  20).  Earliest  choices  quite  often  Inclxide 
a  preponderance  of  "eidventurous"  occupations  such  as  air¬ 
plane  pilot,  ei^lorer,  foreign  correspondent,  etc.  In 
high  school,  choices  Include  more  "prestige"  occupatlons-- 
imfortunately,  more  choices  than  available  positions.  Ey 
and  large,  present  results  Indicate  that  choices  are  modi¬ 
fied  as  the  Indlvldvial  gains  more  experience  and  knowledge 
about  the  occupation.  Prom  the  point  of  view  of  guidance 
and  education,  the  problem  Is  to  minimize  the  n\anber  of 
poor  choices  that  are  made  so  that  students  do  not  waste 
time  getting  an  education  or  working  In  £ui  occupation  or  an 
area  111-sulted  to  their  capabilities. 

Do  children  tend  to  choose  their  father's  occupation? 

To  some  degree.  But  several  tendencies  have  been  noted 
(Jensen  and  Klrchner,  1955)*  First,  exewtly  the  same  occu¬ 
pation  Is  frequently  chosen  (or  entered)  when  the  father  Is 
a  professional,  proprietor,  manager,  clerical  worker, 
craftsman,  or  operative.  Others  enter  Jobs  that  are  at  a 
higher  level  than  that  of  their  father,  particularly  the 
sone  of  service  workers  becone  operatives,  and  sons  of 
vtnskiUed  fathera  enter  operative  and  crafts  work.  Need¬ 
less  to  say,  this  Information  Indicates  that  perents  often 
Influence  their  children's  choice  of  an  occupation.  However, 
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It  shoxild  be  apparent,  too,  that  the  school,  friends,  and 
the  labor  market  situation  all  play  a  role  In  the  occupation 
entered. 

Significance  for  the  Military  Services 

Although  the  uses  of  background  Information  by  the 
military  seirvlces  might  be  subsumed  under  occupational 
significance,  the  extensive  developmental  work  by  the 
military  groups  deserves  special  mention.  Ihe  purpose  for 
which  background  Information  has  been  used  In  the  military 
Is  to  Identify  those  Individuals  who  would  be  best  qualified 
for  specialty  training  schools  and  for  various  duty  assign¬ 
ments  . 

Historically,  this  developmental  work  was  extremely 
important  In  exploring  the  utility  of  background  Information 
for  selection  and  classification  for  occupational  duties. 
During  World  War  II,  the  Army  Air  Corps  experimented  with 
many  kinds  of  information  Including  personality  question¬ 
naires,  interest  blanks,  and  background  information.  In 
almost  every  case,  the  background  information  proved  to  be 
a  valid  predictor  of  success  in  pre-flight  school;  the 
personality  and  interest  measures  did  not. 

The  types  of  information  used  were  described  on  page _ , 

and  included  general  family  background,  work  experiences, 
hobbles,  activities,  organizations,  etc.  The  final'  product 
of  their  efforts  was  to  produce  scales  for  the  pilot  and 
navigator  positions.  Men  scoring  high  on  the  pilot  scale, 
for  exanq)le,  were  likely  to  succeed  in  pilot  training. 

Since  World  War  II,  scales  have  been  developed  by 
each  of  the  military  services  for  technlca],  clerical,  and 
administrative  positions. 
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Pro.lect  Talent's  .Student  Information  Blank 

Hhe  Student  Information  Blank  (SIB)  contains  questions 
on  personal  esgperlences,  family  and  home  background,  and 
plans  for  the  future.  The  questions  axe  largely  objective 
«md  verifiable  facts  or  events  rather  than  subjective  re¬ 
ports  of  personal  feelings.  Students  answered  39^  ques¬ 
tions  about  themselves  on  pre-coded  emsver  sheets.  The 
pre-coded  answer  sheet  was  \ised  because  It  facilitates 
analysis  on  electronic  data  processing  equipment.  (A 
pre-coded  answer  sheet  presents  all  possible  responses  to 
the  Individual,  requiring  only  that  he  mark  the  choice 
most  appropriate  to  his  own  particular  situation.  He  Is 
not  required  to  write  his  answer.)  The  number  of  possible 
responses  to  a  question  ranged  from  2  to  36;  the  majority 
of  the  questions  had  6  responses. 

Several  examples  of  questions  In  the  SIB  are  as 
follows : 

A  question  on  personal  experience 

"13.  How  many  times  in  the  last  3  years  have  i^u 
been  captain  of  an  athletic  team? 

A.  None 

B.  Once 

C.  Twice 

D.  Three  times 

E.  Four  times 

F.  Five  or  more  times" 

A  question  on  the  family 

"176.  How  many  books  are  In  your  home? 

A.  None,  or  very  few  (O-IO) 

B.  A  few  books  (11-25) 

C.  One  bookcase  full  (27-100) 

0.  Two  bookcases  full  (101-250) 

E.  Three  or  four  bookcases  full  (25I-5OO) 

F.  A  room  full — a  library  (50I  or  more)" 
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A  question  on  plana 

What  is  the  greatest  amount  of  education  you 
expect  to  have  during  your  life? 

A.  I  don't  expect  to  finish  hi^.  school. 

B.  I  ei^ect  to  graduate  from  hl£pi  school. 

C.  I  expect  to  obtain  vocational,  business 
school,  or  Jitnior  college  training. 

D.  I  expect  to  obtain  some  (less  than  4  years) 
regular  college  training. 

E.  I  expect  to  graduate  from  a  regular  four-year 
college . 

F.  I  expect  to  study  for  advanced  college  degrees." 

What  follows  is  a  detailed  description  of  the  questions 

that  were  included  in  the  SIB  and  the  reasons  for,  asking 
these  questions.  Because  the  questions  are  of  a  personed 
natiire,  every  step  has  been  tadcen  to  assure  anonymity. 

Under  no  circumstances  will  the  name  of  any  student  be 
disclosed.  .  The  sole  purpose  in  asking  these  questions  is 
to  study  the  patterns  of  experience  and  background  that 
contribute  to  avocationaj.  and  vocational  growth.  The 
questions  are  grouped  under  personal  experiences,  family 
and  the  home,  and  plans  for  the  future. 

A.  Personal  experiences 

1.  . Orgemizatlons .  Questions  were  asked  on  the  number 
and  kinds  of  organizations  in  which  youths  have  particlpatedi 
the  extent  of  their  activity  in  the  organizations,  and  the 
number  of  bffices  held.  .  Organizational  membership  is  one 
form  of  social  peurticipation  and  holding  an  office  indi¬ 
cates  some  degree  of  leadership  experience.  This  experience 
has  been  found  to  be  related  to  entry  and  success  in  the 
milltsury.  In  high  school,  it  is  indicative  that  the  student 
will  not  be  likely  to  drop  out. 

2.  Hobbles  and  recreational  activities.  Questions 
were  asked  on  the  number  and  variety  of  activities  in 
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\rtilch  they  have  participated  regularly,  Including  woodworking, 
collecting  rocks  or  coins,  hunting  or  fishing,  etc.  These 
are  voluntary  activities  indicative  of  an  individual's 
interests,  and  have  been  fo\md  to  be  predictive  of  entry 
into  a  field  of  study  and  into  an  occupational  field. 

3.  Work  experiences.  Questions  Included  the  types  of 
work  they  have  done,  the  amount  of  'r.lnie  they  have  worked 
during  the  school  year,  summer  Jobs  they  have  held,  and 
chores  they  do  at  home.  These  experiences  are  expected  to 
relate  to  a  student's  vocational  growth  and  maturity,  and 

I 

his  choice  of  an  occupation. 

4.  .8o\ircea  of  personal  income.  Questions  were  asked 
on  the  percent  of  the  student's  spending  money  he  received 
from  his  family  and  from  a  Job.  The  questions  may  indicate 
personal  initiative  and  Independence. 

5.  Dating  and  social  activities.  Questions  included 
how  old  they  were  on  their  first  date,  when  they  learned  to 
dance,  and  how  often  they  go  out  in  the  evening.  These  ques¬ 
tions  assess  socleil  experiences  Inqportant  in  the  life  of 
every  adolescent.  Social  development  has  also  been  found  to 
be  related  to  vocational  choice. 

6.  Reading.  Questions  were  asked  about  the  nximber  of 
books  they  read,  and  the  types  of  reading  they  do  (for  ex- 
an^le,  6uiventiu:e,  science  fiction,  classics,  biography,  etc,). 
Amount  euid  type  of  material  read  is  often  indicative  of  Id:?, 
terests  that  relate  to  educational  and  vocational  choices. 

7.  Stttdying.  Questions  included  the  number  of  hours 
per  week  they  spend  studying  and  a  nuober  of  questions  on 
their  approach  to  studying.  The  latter  Included  attentive¬ 
ness!,  reading  and  concentration  habits,  effort,  orderly  habits. 
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etc.  Questions  of  this  type  have  been  helpful  in  Identify¬ 
ing  students  whose  habits  of  study  are  either  poor  or  out- 
stsuidlng.  Research  has  shown  that  study  habits  are  pre¬ 
dictive  of  scholastic  achievement  even  when  ability  has 
been  equated. 

8.  gchoollng.  Questions  were  asked  on  the  curriculum 
In  \rtiich  they  were  enrolled,  the  number  of  co\irses  taken 

In  various  areas  (science,  mathematics,  English,  foreign 
languages,  etc.),  quality  grades  In  these  courses,  transfer 
from  school  to  school,  euid  amount  of  time  missed  from 
school.  These  questions  assess  preparation  and  scholastic 
achievement,  and  relate  to  entry  into  college  and  scholastic 
achievement  in  college. 

9 .  Guidance  and  counseling  experiences.  Questions 
were  aimed  at  determining  \rtiat  persons  ( counselors,.. peurlents, 
teachers,  etc.)  students  approach  for  guidance  Euid  what 
problems  they  discuss.  An  indication  may  be  obtained  of 
the  extent  to  which  school  guidance  facilities  are  being 
used.  Students  were  asked  to  indicate  the  nvunber  of  times 
they  have  discussed  their  school  work,  educational  and 
vocational  plans,  and  personal  problems  with  counselors, 
teachers,  principal,  parents,  siblings,  and  friends. 

10.  Awards .  Questions  were  directed  at  awards  won  in 
acsidemic,  artistic,  athletic,  and  organizational  endeavors. 
It  is  expected  that  aweu:*ds  will  have  some  slgnlflceuice  for 
the  students'  educational  and  vocational  development. 

11.  IJirivlng.  Questions  were  directed  at  determining 
whether  or  not  they  drive  a  car,  how  old  they  were  lAeri  -Uiey 
learned,  whether  they  lesuned  at  school,  and  how  often  they 
have  use  of  a  car.  This  is  a  much-discussed  topic  for  teen- 
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agers.  Using  the  family  (or  one's  own)  car  may  be  for 
dating,  work,  or  a  mechemical  repair  hobby,  therefore, 
the  significance  of  driving  should  be  evaluated  in  con- 
Jxmction  with  these  other  activities.. 

12.  Health.  A  large  number  of  questions  were  asked 
about  the  students'  health.  Ihe  purpose  of  most  of  these 
questions  was  to  identify  students  whose  health  might  limit 
their  educational  e«id  vocational  opportunities.  Other 
questions  were  asked  to  obtain  a  general  statement  of 
health  status. 

B.  The  Family  and  the  Home 

1.  Family  composition.  This  group  of  questions 
doc\mients  the  family  structure:  mother,  father,  siblings, 
grandparents, .and  other  relatives.  Also  included  were 
questions  on  the  parents'  ages,  emd  whether  the  student 

is  a  twin  or  triplet.  These  questions  were  included  largely 
to  introduce  other  questions  on  the  parents '  occupations 
and  education,  and  the  education  of  the  student's  brothers 
and  sisters. 

2,  Parents '  occupations .  ftuestions  were  Included  on 
the  parents '  occupations  posed  in  terms  of  broad  categories 
such  as  skilled,  managerial,  professional,  farm,  etc.  nils 
occupatloneil  classification  is  a  modification  of  that  used 
by  the  U.S.  Bureau  of  the  Census.  Other  questions  asked 
about  the  parents '  employers,  number  of  jobs  their  father 
holds,  level  of  responsibility,  and  questions  on  their 
mother's  work.  The  jmxpose  of  these  questions  is  to  de¬ 
termine  the  socio-economic  status  of  the  family.  Parental 
occupation  has  been  found  to  relate  to  the  children's 
achievement  of  their  educational  and  vocational  goals. 


3.  Parents*  education.  The  amoimt  and  type  of  the 


parents'  education  relates  to  the  amo\int  suid  type  of  edu¬ 
cation  the  student  Is  likely  to  seek. 

4.  Economic  situation.  Ihe  pui^se  of  the$e  q,ue8tlons 
vas  to  establish  a  roxieSa.  Index  of  the  ability  of  the  family 
to  support  the  sttident  while  In  college.  !Ihls  will  help  to 
determine  the  need  for  scholarships.  The  questions  Included 
an  estimate  of  the  total  family  Income  (in  broad  categories) 
and  the  major  source  of  Income  (yages,  professional  fees^ 
etc . ) . 

5.  Description  of  the  home.  The  piorpose  of  these 
questions  was  to  obtain  supplementary  soclb-ecoaomic  Indi¬ 
cators.  Questions  were  directed  at  whether  they  are  apart¬ 
ment  or  home  dVellers,  the  amount  of  rent  paid  or  the  value 
of  the -home;  number  of  people  In  the  home;  and  the  number 
and  type  of  articles,  appliances,  tools,  and  furnishings. 

6.  Family  mobility.  The  purpose  of  these  questions 
was  to  determine  the  significeuice  for  our  youth  of  family 
migration — Intra-regloneQ.,  clty-to-suburbs,  house-to-house; 
Included  were  questions  on  the  number  of  years  they  have 
lived  In  their  commvinlty,  number  of  house -to -hoiase  moves, 
clty-to -suburb  moves,  region  of  the  country  In  which  they 
formerly  lived,  etc. 

7.  Foreign  letnguages  spoken  by  parents.  These  ques¬ 
tions  were  asked  to  determine  the  Influence  of  parents  who 
speak  a  foreign  language  fluently  on  the  student's  achieve¬ 
ment  In  foreign  languages.  Hhe  present  International  situ¬ 
ation  has  eoidiaslzed  the  need  for  more  persons  with  special¬ 
ties  In  foreign  languages.  These  questions  should  help  to 
identify  students  with  good  potential  for  learning  foreign 
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languages . 

8.  Books  and  magazines  In  the  home.  These  questions 
vexe  Indicative  of  the  Interest  of  the  family  In  reading  and 
the  opportunity  afforded  the  student  to  gain  6ui  Interest  In 
reading.  (Questions  were  directed  at  the  number  of  books  In 
the  home  and  the  number  and  types  of  magazines  (news  maga¬ 
zines^  movie  magazines,  parents'  magazines,  etc.). 

9.  Automobiles  owned.  The  number  of  automobiles 
owned  by  anyone  in  the  home  provides  some  Indication  of 
opportunity  for  the  student  to  learn  to  drive  and  learn  to 
repair  a:  car.  It  also  gives  some  Indication  of  economic 
status  even  though  unrelated  to  occupation,  education,  and 
income . 

C.  Plans  for  the  Future 

1.  Educational  plems.  Questions  were  Inclxided  on 
plans  to  quit  hi^  school;  to  attend  college  (full  time  or 
part  time;  j\uiior  college  vs.  four-year  college),  to  attend 
a  trade,  vocational,  or  business  school  after  hl^  school 
graduation,  and  the  total  amount  of  education  (high  school, 
college,  or  graduate  or  professional)  our  youth  expect  to: . 
obtain.  They  were  also  provided  an  opportunity  to  express 
their  ree^ons  for  or  against  going  to  college. 

2.  Specific  college  plans.  Ihis  group  of  questions 
was  asked  only  of  11th  emd  12th  grade  students.  For  those 
who  expected  to  attend  college,  questions  were  sisked  on 
their  choice  of  a  college  major,  the  type  of  college  they 
expected  to  attend,  the  nun^r  of  colleges  to  which  they 
had  applied,  distance  to  college,  plans  to  obtain  a  loan, 
the  source  of  other  financial  support  for  college,  etc. 
These  questions  were  inclitded  to  survey  the  present  state 
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of  specific  college  needs  and  the  need  for  financial 
support. 

3.  Plana  for  marriage  and  children.  The  age  at  yihich 
the  student  plans  to  niarry  often  relates  to  his  plans  for 
college.  Those  planning  an  early  marriage  usually  have  not 
planned  to  attend  college.  In  recent  years  there  appears 
to  he  some  reversed.  In  this  trend. 

4.  Economic  aspirations.  This  group  of  questions  Is 
directed  at  the  student's  concern  for  economic  gain.  Ques¬ 
tions  Inclvided  aspirations  for  Income,  Insureuxce,  savings, 
secvirltles,  and  reed  estate.  It  Is  expected  that  Weae 
questions  may  relate  to  economic  gain  In  the  future. 

5.  Plans  for  fulfilling  mllltetry  service  requirements. 
Military  service  constitutes  an  obligation  for  most  boys 
that  Interrupts  long-range  educational  and  vocational  goals. 
For  others,  the  military  Is  a  potential  career,  .  Questions 
Included  plans  for  entering  the  military,  choice  of  service 
branch,  and  plans  for  a  military  career.  This  will  permit 
estimation  of  what  part  of  the  national  talent  pool  each 
service  might  expect  to  be  available  to  It  under  various 
circumstances . 

6.  Occupational  choices,  decisions,  and  values. 
Questions  Included  the  specific  occupation  chosen;  the 
occupation  preferred;  the  grade  In  which  the  occupation 
was  chosen;  the  nmber  of  different  occupations  considered; 
and  the  considerations,  such  eis  Income,  security.  Interest 
in  the  work,  etc.,  that  are  ijqportant  to  them.  These  ques¬ 
tions  have  proved  useful  for  predicting  the  occupation 
entered,  for  evaluating  maturity  of  choice,  and  for  pro¬ 
viding  guidance  to  students  on  their  vocational  choices. 
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What  Will  Be  Done  With  Ihls  Information? 

It  should  be  apparent  to  the  reader  that  this  lnfor> 
laatlon  will  serve  a  wide  variety  of  purposes.  Plrst,  In¬ 
formation  on  experiences,  backgromd,  and  plans  will  be 
cross -tabulated  with  test  scores  on  aptitudes  and  achieve¬ 
ments  .  When  analyzed,  this  Information  will  be  valuable 
for  evaluating  the  nation's  resources  of  talented  youth. 

Our  youth  will  also  be  asked  to  complete  question¬ 
naires  one,  five,  ten,  and  twenty  yeao's  after  graduation. 

.  In  this  way  It  will  be  possible  to  follow  Individual  growth 
patterns,  particularly  those  of  educational  and  vocational 
significance.  For  e^^unple.  It  will  be  possible  to  study 
the  patterns  of  experiences,  backgrounds,  plans.  Interests, 
abilities,  and  achievements  that  contribute  to  becoming  a 
physician,  scientist,  mechanic,  nurse,  stenographer,  emd 
so  forth.  It  Is  to. the  better  Identification  and  develop¬ 
ment  of  the  talents  of  our  youth  that  we  eiddress  our  efforts. 
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SAX  Scales 

Each  of  the  scales  in  the  tryout  version  Is  described 
and  briefly  discussed  below. 

1.  Leadership 

This  trait  concerns  activities  such  as  taking  charge, 
giving  orders  and  actively  seeking  responsibilities.  It 
is  commonly  identified  as  part  of  the  broad  factor  of 
dominance . 

Sample  Item; 

I  like  to  make  decisions. 

The  tendency  to  seek  responsibility  and  to  seek  to  "teke 
charge"  is  considered  desirable  by  many  people,  euid  is  a 
major  factor  in  vocational  and  educational  choices. 

2.  Vigor 

This  trait  concerns  the  activity  level  of  a  person, 
primarily  on  the  physical  side.  It  is  related  to  the  some¬ 
what  more  broad  factor  of  General  Drive  which  would  include 
hl^  levels  of  both  physicsLl  and  mental  activity.  It  is 
fairly  stable  and  easily  observable  in  the  high  school 
student . 

Sample  Item; 

I  play  games  for  hours  without  getting  tired. 

Measurement  of  this  factor  will  make  it  possible  to 
study  the  extent  to  \diich  persons  with  ability  and  Interests 
are  successful  in  proportion  to  their  drive  level.  It  will 
aid  in  defining  creativity  with  respect  to  amount  of  pure 
activity  Involved.  It  will  make  possible  the  correlation 
of  vigor  with  other  aspects  of  ability  such  eis  productivity, 
scholastic  aptitude,  achievement  in  various  subject  matter 
areas,  overall  adjustment  and  ingenuity. 
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3.  Productivity? 

This  trait  concerns  the  ability  to  get  things  done, 
particularly  In  good  time.  The  eiii{diasls  Is  on  quantity. 

No  eissuiiqptlons  enre  made  as  to  the  quality  of  the  products 
other  than  that  they  are  acceptable,  l.e. ,  meet  the  re> 
qulred  minimum  stemdards.  Essential  characteristics 
seem  to  Include  clear  understanding  of  task  goals;  strong 
need  for  achievement,  oriented  toward  accomplishments  and 
con5)leted  products;  Interests  stable  enough  to  allow  the 
completion  of  products;  and  habitually  good  concentration 
and  efficient  utilization  of  time  euid  effort.  This  trait 
is  closely  related  to  persistence,  vigor,  and  responsibility. 

Sample  Item; 

I  work  fast  and  get  a!. lot  done. 

In  measvirlng  the  extent  to  which  the  person  tends  to 
produce  and  to  produce  efficiently  in  good  time,  we  eu?e 
getting  a  measure  of  one  of  the  aspects  of  human  ability 
that  society  vedues  most.  These  measurements  form  a  good 
criterion  against  >dilch  to  relate  other  kinds  of  personality 
and  training  and  background  variable.  Especiedly  Interesting 
are  relationships  with  bibliographic  Information  and  with 
school  educational  practices. 

4.  Tidiness 

This  involves  a  tendency  to  wsuat  to  keep  things  neat 
&ujd  orderly.  It  Is  probably  related  to  a  more  general  factor 
of  conpulsiveness,  but  as  a  trait  can  be  cleaurly  defined  and 
eemlly  observed  at  the  hl^  school  level. 

Sample  Item; 


I  do  my  homework  as  neatly  as  possible. 
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Tidiness  is  probably  of  lesser  consequence  to  the 
atiidy  per  se;  however,  to  the  extent  that  tidiness  relates 
to  rigidity  or  lack  of  adaptability  on  the  one  hand  or  to 
executive  adaiinlstratlve  or  organising  ability  on  the  other; 
it  can  be  of  considerable  iaportanee  to  prediction  of  voea» 
tional  career,  types  of  educational  training  and  later 
successes, 

5,  Sociability 

This  refers  to  a  tendency  to  like  and  need  to  be  with 
people  i.e,  to  gregariousness.  It  is  related  to  the  eonnonly 
found  broad  factor  of  sociability.  This  is  a  hlj^y  iaportant 
and  observable  aspect  of  behavior  at  the  hii^  aohool  level. 

Sample  Item; 

I  take  a  big  part  in  social  activities, 

The  laqortance  of  sociability  to  waoy  of  the  factors  being 
stxidled  in  the  project  is  obvioiis,  Few  if  any  people  really 
work  alone  and  the  ability. and  extent  to  which  people  relate 
to  other  people  is  a  prooinent  and  deterising  factor  in  the 
type  and  kind  and  success  of  their  later  vocational  and  edu> 
catlonal  efforts.  Certainly  one  of  the  objectives  of  guidance 
and  counseling  has  often  been  to  assist  the  student  in  getting 
along  with  people  In  more  adequate  fashion. 

6.  Self-Confidence 

This  Includes  a  basic  ego -security  manifested  in  con¬ 
fidence  in  one's  personal  worth  and  social  acceptability. 

It  implies  willingness  to  proceed  on  pne's  own  and  a  oeartain 
independence  of  tbou|^  and  action.  Vactorially,  it  is  re¬ 
lated  to  tbe  eomsonly  found  factor*  self-sufficieiiey*  though 
it  correlates  moderately  well  with  mature  personality  as  well, 
It  appears  Important  and  lateble  at  the  hi£^  school  level. 
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gample  Item; 

I'm  equal  to  any  occasion. 

By.  and  large,  SQlf •confidence  Is  a  hlc^ily  desired .  trait. 
Again,  measures  of  S(!lf •confidence  can  be  related  to  many  of 
the  objectives  of  the  study,  such  as  the  effects  of  guidance 
and  co\insellng,  relationship  to  bibliographic  Infoznatlon 
creativity,  productivity.  Ingenuity,  achievaaent  wd  the 
prediction  of  vocation  and  education  success. 

7.  CheerfTilneee 

Shis  tinairi  eoneems  the  tendency  to  '’make  the  best  of 
things,"  be  lighthearted,  look  on  the  bright  side,  and  avoid 
a  pas slnistlo  vlsir.  It  does  not  relate  closely  to  any  of  the 
six  broad  factors  specified  earlier,  yet  is  coscsonly  Bsatloasd 
In  the  literature  as  a  eell -defined,  fairly  stehle  trait. 

It  is  ons  eesily  obssrved  at  ths  hlih  school  Isvel,  and  pro - 
bshly  of  oonsidershls  iaportae^s  to  futurs  bthavier. 

SssBle  Itemi 

I  M  food^tursd  aeit  of  the  tiai. 

This  trait,  a  generally  desirable  one,  probably  has  its 
aoit  y^ortant  relationship  to  the  study  with  reipeet  to  ths 
eheiees,  ^ans  ud  decisions  Mds  by  hii^  ssheel  studsatsi 
^ss  in^ts  ^babJ^  higU=y  influsRMd  by  pasral  sut¬ 
ler  on  lifs,  that  is  optiMsa,  hepsfulMiSi  sagansssi  shssr> 
fulness,  vsfsus  jpsssiiy^Ba,  sadasss,  sad  ssrisusasisi  It  is 
fsssibls  ^t  asasiff»Bal  ea  t^s  try^t  yil  jprevs  te  he 
yg^Fiyafttiag  hetwiea  hinds  gf  SMipftiMa  luA  «i 

sifyse  essupayea  as  en^sssd  te  rsssarsh  esnsyiengt 

8.  Oulture 

fhis  tryt  seaeefas  %ts!idsass  te  aipfeeiate  aai  dis^ey 
refin^st,  eult\ye,  ped  taste,  uid  aesthetie  ^ap. 
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ElstorlccLLly  these  Items  have  been  closely  related  to  the 
often  discussed  masculinity -feminity  factor.  However,  the 
culture  scale  seems  to  be  soich  less  a  heterogeneous  nass  of 
correlated  attributes  than  does  the  traditional  masoilini^- 
femlnlty  factor.  It  Is  probably  a  little  less  observable  In 
the  hl£^  school  setting,  than  some  traits,  but  bears  laqpor- 
tant  Isqpllcatlons  for  future  behavior. 

Sangde  Item; 

I  en^oy  woi^s  of  art. 

This  particular  trait  appears  to  have  somewhat  less  Im-. 
plication  for  the  study  as  a  whole,  but  has  some  bearing  w 
the  selection  of  hobbles,  avocations  and  vocational  choices.. 

Vfttlveness 

This  Is  a  clearly  recognizable  aspect  of  behavior,  of 
considerable  In^rt.  It  Is  characterized  by.  desire  to  talh 
abovit  anything  and  everything  with  almost  anybody,  sometimes 
to  the  eventual  dlscomfitxxre  of  the  talker.  Factorlally, 
te^lEatlveness  seems  to  be  related  to  vigor,  to  soclabidlty 
suid  perhaps  to  lack  of  self -discipline.  Even  so  It  seems 
to  have  some  essence  of  Its  own.  Bright  children  are  often 
talkative,  as  might  be  e:q)ected  from  their  siqperlor  verbal 
facility.  Yet  average  to  dull  children  may  also  display 
this  trait. 

Sample  Item; 

I  steurt  conversations  easily  with  strangers. 

The  measurement  of  talkativeness  relates  soamwhat  less 
well  to  the  ohjectives  of  the  overall  study  thin  other  traits. 
Certainly,  however,  the  relationship  of  talkatlveaess  to  sudi 
factors  as  Tlgpr,  sociability,  and  self-confldsnoe,  ete. 
would  be  of  considerable  Interest^  thou^  somewhat  outside 
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the  stated  measureaieiit  goals  of  the  study.  Talkativeness 
olght  also  he  Interestingly,  perhaps  negatively,  related 
to  productivity.  Ingenuity  and  vocational  successes. 

10.  Jjagpulalveneas; 

This  trait  concerns  the  tendency  to  nake  snap  decisions, 
to  act  without  full  consideration,  to  do  and  say  things  on 
Is^mlse  and  whim.  It  If  .  probahly  related  to  lack  of  Self- 
dlsclpllne,  and  perhaps  Indirectly  to  drive.  This  appears  to 
be  a  trait  shlch  Is  observable,  but  perhaps  soiaevhat  dlfflc^LLt 
to  self>rate. 

gaaple  Item; 

I  usually  act  on  the  first  plan  that  cooes  to  mind. 

The  measurement  of  Impulsiveness  bears  an  laportant  re¬ 
lationship  to  Items  such  as  stability  of  occupational  and 
educational  choice,  the  number  of  switches  In  program  and 
occupation,  effectiveness  of  counseling  and  factors  Involved 
In  making  decisions  cuid  plans. 

11.  Persistence 

This  trait  refers  to  a  tendency  to  keep  on  working  on 
something  until  It  is  finished  or  accomplished.  It  Is  un¬ 
doubtedly  related  to  drive  and  also  to  self-dlsclpllne,  since 
it  Is  effectively  drive  directed  toward  some  goal.  This  Is 
observable  at  the  hi^  school  level  and  Is  very  importetnt 
to  futiu:«  behavior. 

Sample  Item; 

I  usually  stick  to  the  things  I  start  until  I 
finish  them. 

As  this  trait  refers  to  a  tendency  to  continue  and 
persevere  In  working  towards  some  long-range  goal.  It  Is  of 
Importance  to  relate  it  to  suiy  of  the  long-term  aspects  of 
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the  data  being  gathered.  It  Is  especleuLly  Important  In 
evaluating  satisfaction  with  career  choices,  educational 
choices,  and  In  examining  the  current  choices  against 

/ 

4 

follow-up  activities . 

*  12.  Cedmness ; 

» 

This  concerns  the  ability  to  react  appropriately  to 
emotional  situations  rather  than  dlsplayilng  extremes  of 
er-elatlon,,  temperament,  excitability,  depression,  etc. 
Brennessand  smoothness  of  temperament  are  the  observable 
characteristics  and  the  trait  Is  considered  hlg^y  Imiortant. 
This  trait  Is  clearly  related  to  the  broader  factor  mature 
personsQ-lty. 

*  Sample  Item; 

I  rarely  lose  my  temper. 

¥ 

!»  Many  of  the  objectives  of  the  study  have  to  do  with  the 

extent  to  which  the  student  is  achieving  a  satisfactory  ad¬ 
justment  with  his  environment  and  Its  demands.  Therefore, 
the  measurement  of  calmness  provides  a  measure  which  is 
highly  related  and  highly  important  to  the  child's  ability 
to  integrate  himself  into  his  school  and  work  situation  in  . 
such  a  way  that  he  can  take  advantage  of  his  abilities  and 
prior  achievements.  Measurement  on  this  trait  will  make  it 
possible  to  study  the  extent  to  which  emotional  stability  is 
related  to  occupational -vocational  success,  effectiveness  of 
counseling,  efficient  decision  making,  etc. 

13.  Social  Adjustment 

This  trsdt  concerns  reactions  and  Interactions  with 
others.  On  the  one  end,  it  concerns  helpfulness  and  coopera- 

0 

*  tlon;  on  the  other,  behavior  which  is  distinctly  and  overtly 

anti -social  and/or  hostile.  This  trait  is  extremely  important 
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in  the  hi^  school  setting.  Factorially,  it  is  probably 
related  to  sociability^  but  has  often  been  identified  sis 
a  separate  factor. 

Sample  Item; 

People  seem  to  think  I'm  cooperative. 

Meas\irement  along  this  dimension  is  very  important  in 
attempting  to  determine  what  conditions  of  background  and 
interest  and  aptitude  go  along  with  the  desire  to  help  and 
cooperate  and  work  efficiently  with  others.  There  is  un¬ 
doubtedly  a  great  deal  of  overlap  between  this  trait  and 
sociability, 
lit-.  Theoretlcality 

This  concerns  the  tendency  to  be  a  thinker  rather  than 
a  doer,  to  prefer  intellectual,  activity  of  all  kinds  to  work¬ 
ing  with  tangible  things.  It  has  been  identified  as  a  factor 
in  some  studies,  but  is  probably  related  to  sociability  and 
self  sufficiency.  It  is  importemt  to  behavior  and  probably 
easily  observed  and  rated.  It  is  very  likely  to  be  a  stable 
characteristic  at  the  hl£d^  school  level. 

Sample  Item; 

I  spend  a  lot  of  time  by  myself  thinking. 

This  dimension  is  extremely  Importeuit  with  respect  to 
the  kind  of  vocation  selected  euid  the  extent  to  which  the 
person  pays  attention  to  and  is  concerned  with  society  and 
people  and  things,  as  opposed  to  ideas,  concepts,  philosophies^ 

It  is  a  variable  to  idiich  effectiveness  of  counseling  and 
types  and  kinds  of  educational  and  vocational  choice  and 
decision  making  should  be  related. 

15-  Responsibility 

This  trait  involves  not  the  active  seeking  of  responsibility 
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but  the  willingness  to  accept  and  discharge  responsibilities, 

* 

even  though  they  be  distasteful,  to  the  best  of  one's  abili¬ 
ties.  This  person  has  a  strong  sense  of  duty  and  can  be 
depended  upon  to  carry  out  his  assignment  even  at  personal 
discomfort.  This  trait  is  observable  in  hl^  school  and  Is 
factorledly  related  to  mature  personality  and  to  conformity 
and  persistence. 

Sample  Item; 

People  say  they  can  count  on  me. 

Responsibility,  willingness  to  accept  and  discharge  re¬ 
sponsibilities,  is  ceirtainly  one  of  the  most  Important  of 
the  work  attitudes  or  traits,  and  as  such  can  reasonably  be 
related  to  almost  any  of  the  variables  under  study. 
l6.  Social  Sensitivity 

This  trait  Involves  the  ability  to  put  oneself  in 
another's  place.  This  person  is  aware  of  and  concerned 
about  the  feelings  and  desires  of  others.  The  trait  Is  per¬ 
haps  somewhat  rare  In  high  school,  but  constitutes  an  important 
part  of  behavior.  It  is  factorlally  related  somewhat  to 
sociability  and  mature  personality. 

Sample  Item; 

I  don't  like  to  see  someone's  feelings  hurt. 

IT.  Group-centeredness 

This  trait  concerns  preoccupation  with  the  good  or 
welfare  of  the  group  as  opposed  to  self-centeredness.  While 
amenable  to  self-rating  and  undoubtedly  In^rtant  to  future 
behavior.  It  Is  perhaps  less  observable,  behavlorally,  at 
the  hl£^  school  level  than  some  other  trcdts.  f^ctoricLLly, 
it  tends  to  be  related  to  sociability,  mature  personality, 
and  conformity. 
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Sample  Item; 

I'd  give  up  my  place  on  the  team,  If  It 
meauit  the  team  would  win. 

The  trait  of  placing  one's  own  advancement  ahecul  of 
that  of  the  group  or  vice-versa  Is  highly  important  to 
getting  along  in  today's  complex,  highly -peopled,  society. 
Measviremehts  here  mlg^t  be  related  to  many  background  fac¬ 
tors,  to  many  other  personality  variables,  such  as  leadership 
and  vigor  and  to  various  family  and  cultured,  factors,  as  well 
as  vocational  and  educational  successes. 
l8.  Conventionalism 

This  concerns  the  trait  of  conforming  and  adapting  to 
rules  and  conventions,  whether  liking  them  Or  not.  It  in¬ 
volves  a  high  respect  for  the  rule -making  bo^  (not  necessarily 
society,  but  perhaps  a  sub-culture)  with  which  an  identifica¬ 
tion  is  achieved.  It  is  related  to  group -orientation  emd 
sociability  and  negatively  to  self-sufficiency. 

Sample  Item; 

I  obey  rules  whether  I  like  them  or  not. 

Perhaps  the  most  Interesting  relationship  would  be 
conventionalism  and  the  creativity  test.  Productivity  and 
originality  are  some  of  the  other  areas  where  relationships 
with  conventionalism  should  be  of  value  for  study.  The  effect 
of  conventionalism  on  decision-making,  including  its  prompt¬ 
ness  and  its  adequacy,  and  on  predictability  of  occupation 
and  occupational  success  are  certainly  of  Interest. 
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Pre -testing  of  the  Student  ActlvltleB  Inventory 

While  Project  personnel  felt  considerable  confidence 

In  the  psychometric  and  psychological  procedxzres  >dilch  had 

produced  the  experlmental:form  of  the  Student  Activities 

Inventory,  It  was  nevertheless  felt  to  be  essential  that 

the  experimental  form  of  the  test  be  pre-tested  on  a  sub- 

steuitial  number  of  students.  In  this  way,  items  and  scales 

could  be  refined  and  administrative  problems  taken  care  of. 

Therefore,  sirrangements  were  made  to  give  the  Inventory  to 

several  hundred  students  in  the  Pall  of  1959* 

A.  The  Administration  of  the  Experlmenteil  Test, 

Fall  1959 

The  experimental  form  of  the  test  was  given  to 
several  groups,  each  of  which  had  taken  well-known  persona¬ 
lity  tests  previously.  In  this  way,  it  was  possible  to  get 
item  analysis  data  and  to  measure  the  relationships  of  the 
expS^rlm^H'tel  scales  with  other  tests  at  the  same  time.  Table  Vlll*4 
.  shows  the  groups  which  received  the  tests. 

■  Table  Vlll*4 

Fall  19^9  Experimental  Administration 
of  the  Student  Activities  Inventory 


Group 

N 

Grades 

Sex 

Supplementary  Test 

Youngstown,  Ohio 
Schools 

186 

9-10 

Both 

California  Psycho¬ 
logical  Inventory 

Amherst  College 

110 

lU 

Boys 

Edwards  Personal  Pre¬ 
ference  Schedule 

North  Catholic  High 
School,  Plttsbur^^ 

250 

9-12 

Boys 

SRA  Youth  Inventoiy 

Sacred  Heaurl:  High 
School,  Pittsburg^ 

190 

12 

Girls 

SRA  Youth  Inventory 

:COJ‘  1 

.  -•  .^1  .  *. 

■>  h.  ;  ..  ■ ,  !  .  >  J 

.J  -0  .’C  c. 

i 

i 


7 


i 

y 
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While  It  was  recognized  that  the  schools  Involved 
were  not  a  random  sample.  It  wsui  felt  that  for  the  purposes 
of  Item  analysis  and  estimating  test  Interrelationships  they 
were  sufficiently  like  the  ultimate  test  i>opulatlon  to  provide 
useful  results. 

Results  of  these  experimental  administrations  were 
placed  on  punched  cards  and  processed  by  computer.  Conments 
of  the  varioiis  classroom  teachers  who  administered  the  tests 
were  collected  and  tedcen  Into  consideration  In  estimating  the 
time  required,  and  in  the  preparation  of  directions  for  stu¬ 
dents  and  administrators  for  the  fineLL  form. 

S.  ResilLts  of  the  Experimental  Tryout 
1.  The  Response  Options 

The  percentage  choosing  each  option  indicated 
that  the  negative  end  of  the  5 -choice  sceLLe  being  used,  viz., 
"not  at  all"  was  not  being  chosen.  This  Indicated  that  It 
was  too  strong  a  term.  A  small  study  was  done  in  which  de¬ 
scriptive  words  of  this  type  were  scaled  by  37  beginning 
college  students,  and  the  five  choices  best  distributed  were 
selected  for  the  5 -choice  scale  in  the  final  form.  This  re¬ 
sulted  in  the  changes  shown  below: 


FROM; 

TO: 

A. 

Very  well 

Very  well  (no 

chemge) 

B. 

Quite  well 

Well 

C. 

Fairly  well 

Fedrly  well  (no  change) 

D. 

Not  very  well 

Slightly 

E. 

Not  at  60.1 

Hot  very  well 

2.  The  Item  Analysis 
a.  Procedures 

For  purposes  of  item  analysis  the  items  .. 


were  dichotomized  for  scoring.  The  two  extremes  at  the 
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favorable  end  of  the  scale  were  each  scored  +1,  and  the 
other  three  were  scored  -1.  In  the  case  of  negatively 
worded  items,  the  two  extremes  at  the  unfavorable  end  of 
the  scale  were  scored  +1,  and  the  other  three  scored  -1. 

Score  on  a  scale  was  derived  by  taking  Rights  minus  Wrongs. 
The  percentage  of  the  group  choosing  each  option  for  each 
item,  and  point -biserieuL  correlations  of  each  item  with 
total  score  on  its  own  scale  were  obtained  for  the  items  on 
the  a  priori  key  for  the  l8  scales.  Each  a  priori  scale  key 
was  divided  in  half  so  that  half -test  s  cores  could  be  coire- 
lated  as  estimates  of  scale  reliabilities.  Intercorrelations 
of  all  of  the  scales  were  obtained  based  upon  the  entire  com¬ 
bined  high  school  groups  (N  =  623),  excluding  the  Amherst 
Sophomores.  Uniquenesses*  were  also  computed  based  upon  the 


♦Flanagan,  John  C.  Technical  Report,  Flanagan  Aptitude 
Classification  TestsT  Chicago:  Science  Research  Associates, 
Pp.  17-22. 


extent  to  which  each  scale  score  coitLd  be  predicted  from  the 
multiple  correlation  with  all  of  the  other  scales. 

A  preliminary  analysis  was  done  and  the  item 
analysis  repeated.  Scoring  eind  item  analysis  were  done  en¬ 
tirely  by  computer. 

b.  Results  of  the  item  analysis 

1)  Based  on  the  point -biserleiL  correla¬ 
tion  several  items  were  eliminated  from  each  scale  as  not 
being  consistent  with  the  renali^er  of  the  scale. 

2)  Several,  of  the  scales  proved  unre¬ 
liable  and  offered  little  in  the  way  of  unique  variances. 
Scale  1,  Leadership,  was  split  into  Scale  1,  Leadership,  and 
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a  new  scale,  19,  Bossiness,  In  an  attempt  to  refine  It. 
Similarly,  Scale  8,  Culture,  was  split  Into  Scale  8,  Manners, 
and  Scale  20,  Culture. 

3)  The  Item  analysis  was  re-computed,  pro¬ 
ducing  the  results  shown  In  Table  Refinements  based  upon 

♦ 

this  Information  gave  rise  to  the  final  form.  It  will  be 
noted  that  the  reliabilities  of  the  various  preliminary  scales 
are  quite  modest.  However,  It  should  be  remembered  that  the 
half -test  scores  which  were  Intercorrelated  were  hewed  upon 
only  3  or  k  Items  In  several  cases. 

Table 

Reliabilities  and  Uniquenesses 
Student  Activities  Inventory  -  Fall  1959  Tryout  -  N  =  623 
Scored  R  -  W  +  200 


No  .  of 
Items 

^11 

2 

R 

2** 

R 

t 

1. 

Leadership 

3 

.252 

.167 

.403‘ 

.139 

.264 

2. 

Vigor 

8 

.523 

.326 

.687 

.303 

.384 

3. 

Productivity 

k 

.297 

.392 

.458 

.372 

.086 

4. 

Tidiness 

9 

.523 

.395 

.687 

.375 

.312 

5. 

Sociability 

8 

.416 

.408 

.588 

.388 

.200 

6. 

Self -Confidence 

6 

.203 

.095 

.337 

.065 

.272 

7. 

Cheerfulness 

7 

.321 

.411 

.486 

.391 

.095 

8. 

Manners 

8 

.476 

.511 

.645 

.495 

.150 

9. 

Talkativeness 

5 

.119 

.166 

.213 

.138 

.075 

10. 

Impulsiveness 

5 

.197 

.l4i 

.329 

.113 

.216 

11. 

Persistence 

5 

.227 

.291 

.370 

.268 

.102 

12. 

Calmness 

9 

.556 

.434 

.715 

.415 

.300 

13. 

Social  Adjustment 

7 

.344 

.514 

.512 

.498 

.014 

14. 

Theoretical 

7 

.179 

.198 

.304 

.172 

.132 

15. 

Responsibility 

8 

.417 

.517 

.589 

.501 

.088 

l6. 

Social  Sensitivity 

8 

.325 

.317 

.491 

.294 

.197 

17. 

Group  Centeredness 

6 

.300, 

.288 

.462 

.264 

.198 

18. 

Conventional 

5 

.066 

.074 

.124 

.043 

.081 

19. 

Bossiness 

9 

.071 

.086 

.133 

.055 

.078 

20. 

Culture 

134*** 

.390 

.386 

.561 

.366 

.195 

*  Corrected  by  Spearman-Srown 
**  Corrected  by  Vfherry  Shrinkage  Formula 
***  l6  Items  not. keyed  , 
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3-  Intercorrelations  of  the  Experimental  Fom 

with  Supplementary  Tests 

Tables  Vill^iEmdVlilitsimimarlze  the  Interre)^  - 
latlonshlps  of  the  Student  Activities  Inventory  scales  with 
the  gdwards  Personal  Preference  Schedule,  and  with  the 
California  Psychological  Inventory.  The  intercorrelations 
of  SAI  scedes  with  the  SRA  Youth  Inventory  are  essentially 
zero,  and  are  thus  not  reported  here. 

a.  SRA  Youth  Inventory 

The  lack  of  Intercorrelation  of  SAI  scsdes 
with  the  scales  of  this  inventory  was  expected  and  appears 
reasonable.  It  should  be  noted  that  the  Youth  Inventory  is 
simply  a  problem  checklist,  where  problems  are  classified 
by  surface,  non -psychological  type.  It  is  reasonable,  there¬ 
fore,  that  such  "scores"  (number  of  problems  in  each  area) 
would  not  correlate  with  scales  developed  from  a  much  more 
basic  psychological  approach.  The  Youth  Inventory  is  some¬ 
times  also  scored  for  a  9th  scale,  Basic  Difficulties,  in¬ 
tended  to  identify  students  needing  counseling.  It  appears 
likely  that  this  scale  (unfortunately  not  available  for  the 
cases  in  this  analysis)  might  have  correlated  moderately  with 
several  of  the  SAI  scales. 

b.  California  Psychological  Inventory 

It  can  be  seen  from  Table  ( see  page/) 

that  the  relationships  between  SAI  scales  and  the  CPI  scsdes 
are  low,  but  generally  in  the  expected  direction.  The  low 
nature  of  these  correlations  appears  to  be  due  partly  to  the 
relatively  low  reliability  of  the  experimental  SAI  scales 
(partially  a  function  of  their  shortness),  eind  partly  to  the 
expected  differences  arising  from  the  fact  that  most  of  the 
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CPI  Bcales  were  empirically  derived  from  a  "discrimination 
analysis",  whereas  SAI  scales  were  derived,  primarily  from 
the  psychological  analysis  of  behavior  with  respect  to 
a  more  limited  population  (hl^  school  students).  With 
these  qualifications  in  mind,  it  appears  that  the  two  in¬ 
ventories  are  reasonably  consistent  with  each  other  and 
that  many  of  the  domains  being  measured  are  similar. 

c.  Edwards  Personal  Preference  Schedule 
Again  the  interrelationships  of  SAI 

scales  with  the  EPPS  scales  are  low,  but  generally  as 
expected  (see  Table page  ^  ) .  These  correlations 
appear  to  be  low  for  the  same  reasons  as  applied  to  those 
with  the  CPI.  While  the  Edwards  scales  were  developed 
similarly  to  those  in  the  SAI,  they  were  based  upon  a 
different  psychological  system  (Murray's  Needs).  Never¬ 
theless,  as  with  the  CPI,  there  is  sufficient  consistency 
and  reasonableness  in  the  relationships  to  support  the  be¬ 
lief  that  similar  domains  are  measured. 

d.  Summary 

The  intercorrelational  relationships  of 
SAI  scales  with  the  supplementary  tests  were  seen  as  lending 
empirlceiL  support  to  the  construct  validity  of  the  inventory. 
The  fact  that  the  scales  correlated  at  all  under  the  condi¬ 
tions  of  the  experiment  was  seen  as  a  favorable  factor.  It 
is  fully  recognized  that  the  SAI  scales  Eure  essentially 
a  priori  combinations  of  items  which 
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Table  VIII-6 

iBtaroorralations  of  BAl  Sealoa  with 


California  Pasroholofieal  lavaatory 


Note:  or  -  iodleataa  r«15-.l8  in  the  plua  or  ndnus  diraotion  raapeotiToly 

(aisnif leant  at  the  two-tailed  ^  level) 

S  or  S  indloatea  r  of  .19-.24  in  the  plua  or  ndnua  direetion  reapootively 
(aifaifioant  at  the  two-tailed  1%  level) 

M  or  S  indieatea  rot  .25-*^  ia  the  pIna  or  alaaa  direetion  re^peotively. 
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Table  mi-7 

Intereorrelations  of  SAl  Seales  tdth 
Idwards  Personal  Preference  Schedule 
(110  Anherst  College  Sophomores) 


Achievesieat 

Deference 

Order 

Exhibition 

m  g 

o  •H  e 

1  I  1 

1  2  £  1 

4  ;;  .3  1 

Dominance 

Abasesmnt 

Huturance 

Change 

Endurance 

Heterosex. 

Agression 

Consistence  Score 

Leadership 

Vigor 

Productivity 

Tidiness 

Sociability 

M 

S 

-  + 

+ 

M 

• 

Self-Confidence 

Cheerfulness 

Manners 

Talkativeness 

Impulsiveness 

-  + 

+ 

• 

S  .  - 

Persistence 

Colranesa 

Social  Adjustment 

Theoreticollty 

Pesponsibillty 

M 

S 

s 

s 

* 

M 

+ 

H 

Social  Sensitivity 
Qroup-Centeredness 
Conventionality 
Bossiness 

Culture 

XI  1 

+ 

1 

M 

ee 

•I- 

Note;  4*  or  -  indicates  r  of  .19-*24  in  the  plus  or  minus  direction,  respectively 
(significant  at  the  two-tailed  ^  level) 

8  or  S  indicates  r  of  .29I-.29  in  the  pl\M  or  minus  direction,  respectively 
(significant  at  the  two-tailed  25(  level) 

M  or  H  indicates  r  of  •30-*^  ia  the  plus  or  minus  direction,  respectively. 
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do  not  eQ.1  measure  the  saoe  thing  to  the  same  degree. 
K>wever,  It  vas  demonstrated  that  the  scales  vere  measuring 
the  desired  domains  of  personality,  and  that  the  refined  and 
consolidated  flncLL  form  could  be  expected  to  yield  more 
reliable  sceiLe  correlations. 

C.  The  Final  Form 

On  the  basis, of  the  Item  analysis,  intereorrela- 
tlonal  data,  and  the  unlquenessess  and  reliabilities  of  the 
various  scales,  several  scales  were  omitted,  others  were 
combined,  and  about  half  of  the  Items  dropped..  Items  lAlch 
showed  poor  item  response  distribution,  high  percentage  of 
"omits”,  appeared  ambiguous  or  otherwise  undesirable,  or 
failed  to  relate  to  one  of  the  original  20  scales,  were 
dropped.  In  this  way  the  number  of  items  was  reduced  to 
150  for  the  final  form. 

While  150  Items  were  retained  in  the  final  form, 
only  13  scale  scores  could  be  obtained,  due  to  practical 
limitations  in  scoring  and  analysis .  The  13  best  of  the 
possible  scales  vere  selected  for  scoring.  For  the  "Final 
Form",  scales  with  low  uniqueness  but  relatively  high  and 
consistently  similar  patterns  of  intercorrelatlons  were 
combined,  so  that  the  euiditlonal  items  would  provide  in¬ 
creased  scele  reliability.  Those  with  low  reliability,  low 
uniqueness,  8uid  no  such  pattern,  vere  dropped.  In  one  or 
two  cases,  scales  were  retained  on  the  basis  of  their  psy¬ 
chological  potential.  The  13  scales  scored  In  the  final 
form  are  show,  along  with  the  ooadilnations  which  vere  made, 
in  Table  Vin-S  (p^e  VIlI-112). 
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TABLE  VIII-8 

Scales  Scored,  SAI  Final  Form 


Scale 

Husiber 
of  Item^ 

ExperlJiental  Seale 
from  Ehlch  Derived 

1..  Sociability 

12 

Sociability  and  Cheerfulness 

2.  Social  Sensitivity 

9 

Social  Sensitivity 

3,  Lapulslveness 

9 

Impulsiveness 

4.  Vlapr 

7 

Vigor 

5.  Calmness 

9 

Calmness 

6.  Tidiness 

11 

Tidiness 

?•  Culture 

10 

Culture  and  Manners 

8..  Leadership 

5 

Leadership 

9.  Self-Confidence 

12 

Self -Confidence 

10.  Mature  Personality 

2k 

Productivity,  Persistence 

and  Responsibility 

11.  Convention€d.lty 

7 

Conventionality 

12.  Theoreticedlty 

8 

Theoret 1 call ty 

13.  Group-Centeredness 

6 

Group-Centeredness 

Unscored 

ZL 

All  scales 

I 
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It  Is  not  expected  tb&t  the  13  8CcQ.es  scored  In 
the  final  form  cover  the  rahge  of  hl£^  school  personality. 
They  represent,  rather,  the  best-oeasured  of  the  Initial 
group  of  scales.  However,  effort  will  be  made  to  retain  the 
muffh  broader  coverage  of  the  1^0  Individual  Itoas  themselves. 
If  feasible,  to  relate  to  student  behavior.  Xhus  It  Is 
planned  not  to  rely  solely  on  the  scale  scores  In  this  curea. 


ir 
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Appendix  8  b 


The  Description  and  Development 


of  the  Interest  Inventoi 


General  Purpose: 

The  general  purpose  of  the  Interest  Inventory  was  to 
obtain  direct  expressions  of  Interest  (like  versus  dlslllce) 
toward  occupations  representing  a  broad  reuige  of  fields, 
dlfferentleLL  ability  requirements,  differential,  educational, 
requirements,  etc.  Similarly,  expressions  of  Interest  were 
desired  on  activities  Including  vocational,  activities,  sports, 
school  subjects,  hobbles,  pastimes,  etc. 

It  was  the  feeling  of  the  advisory  groups  emd  the 
staff  that  an  Inventory  which  approximately  paraddeled  ac¬ 
cepted  Instruments  In  present  use  should  be  Included  In  or¬ 
der  that  fxurther  empirical  tests  could  be  meuie  of  their  pre¬ 
dictive  power  aind  their  usefulness  in  guidemce.  The  object¬ 
ive,  the  Painel  felt,  was  to  gather  a  varied  set  of  items 
Into  the  study  so  that  these  could  be  combined  later  in 
whatever  ways  would  be  desirable  to  reproduce  fedrly  closely 
the  dimensions  of  severed,  of  the  existing  inventories. 
Description  of  the  Inventory: 

A.  Definition  of  am  Interest.  The  commonly  used  In¬ 
terest  inventories  define  ’’interest"  in  terms  of  expressed 
liking  or  preference  for  various  occupations,  activities, 
school  subjects,  types  of  people,  social  situations,  etc. 

This  is  the  definition  of  "interest"  Intended  here.  Other 
definitions  of  "interest"  have  been  made  In  terms  of  amount 
of  information  retained  in  given  subject  matter  areas  (see 
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the  Ii^foroatidc  Test)  aod  In  terms  of  overt  activities  (see  . 
the  Student  Information  Blank). 

Inventoried  Interests  are  subjective  as  contrMted  vlth 
the  objectivity  of  latUwnts  measured  by  information  and  by 
reports  of  overt  activity.  Furthermore,  inventoried  inter¬ 
ests  are  not  Independently  verifiable  or  observable.  Inven¬ 
toried  interests  may  be  vsaid:to'..be  molar,  subjective,  dispo¬ 
sitions  of  the  respondent  toweurd  common  activities  and  ex¬ 
periences.  Xhe  specific  activities  and  eiqperienoes  included 
in  this  inventory  are  those  familiar  to  a  high  school  popu¬ 
lation  and  relevant  to  the  project;  1.  e.,  occupations, 
school  subjects,  and  activities. 

B.  Inventory  directions.  The  jnirpose  of  the  directions 
to  the  Inventory  vas  to  describe,  define,  azid  clarify  the 
task  of  the  respondent;  the  context  in  which  the  items  are 
to  be  considered;  and  to  motivate  the  individual  to  respond 
in  a  manner  which  truly  reflects  his  feelings.  In  this 
task  we  followed  closely  upon  precedents  established  by 
Strong  and  K\ider. 

The  respondent's  task  is  to  indicate  the  degree  to 
which  he  likes,  dislikes,  or  is  indifferent  to  a  variety  of 
occupations  and  activities.  In  order  to  clarify  the  context 
in  which  the  items  are  to  be  considered,  the  respondent  is 
t|old  to  consider  only  the  activity  involved  in  the  occiipatlons; 
not  to  consider  associated  factors  such  as  salary,  social 
standing,  permanence  of  the  work,  training  or  education  need¬ 
ed,  etc.  Pasrtleular  emphasis  was  placed  t^cm  responding  in 
terms  of  the  degree  of  his  liking  or  disliking  the  activity 
Involved.  The  directions  read  as  follows: 

"This  section  contains  items  for  you  to  answer  about 
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occupations  you  would  like  and  things  you  would  like  to  do. 

For  each  item  assume  that  jrou  would  have  any  necessary 
training  or  education  that  would  he  required.  DiBrei:ard 
salary j  social  standings  permanence;  etc.;  in  feet  euiything 
except  how  well  you  would  like  to  do  the  work  or  the  activity. 
Your  answer  does  not  mean  that  you  plan  to  go  into  an  occu¬ 
pation  if  you  say  you  would  like  it — only  that  it  involves 
the  kind  of  activity  you  think  you  would  enjoy." 

C .  Item  format .  Item  stems  were  presented  in  the 
briefest;  simplest  form  possible.  It  was  the  feeling  of  the 
staff  that  statements;  phrases ;  or  complete  sentences  are 
unnecessary  if  the  same  content  can  be  contained  in  a  single 
word.  Further,  brief  items  would  be  less  likely  to  pose  a 
reading  difficulty  problem;  would  be  likely  to  consume  less 
reading  time;  and  would  take  up  less  space  in  the  test  book¬ 
lets. 

I'or  each  item,  the  respondent  was  asked  to  indicate  the 
degree  to  which  he  would  like  or  dislike  the  occupation  or 
activity  on  the  following  scale: 

a.  I  would  like  this  very  much. 

b.  I  would  like  this  fairly  well. 

c.  Indifferent  or  don't  know  much  about  it. 

d.  I  would  dislike  this  a  little. 

e.  I  would  dislike  this  very  much. 

Developing  the  Item  Pool: 

The  items  in  the  Strong  Vocational  Interest  Blank,  the 
Kudsr  Breference  Record,  the  Thur stone  Interest  Schedule  and 
the  Minnesota  Vocational  Interest  Inventory  were  typed  on 
cards  and  the  content  analyzed  logically  to  reduce  the  re¬ 
dundancy  among  the  items.  The  content  analysis  involved 
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sorting  items  by  occupational  titles  and  by  activities.  Ac¬ 
tivities  \di08e  content  could  be  sorted  vith  occupational 
titles  vere  so  sorted.  Thus  the  final  list  consisted  largely 
of  occupational  titles  and  occupational  activities,  and  a 
short  list  of  activities  not  clearly  associated  vith  occu¬ 
pations  . 

Several  preliminary  versions  of  the  Interest  Inventory 
vere  presented  to  the  advisory  panels  for  reviev  and  comment. 
The  recommendations  of  the  Panel  members  the  Judgment 
of  the  staff  vere  used  to  reduce  the  number  of  items  to  a 
manageable  number. 

As  a  further  check  on  the  adequacy  of  coverage,  the 
reduced  set  of  occupational  titles  vas  sorted  vith  the  Bu¬ 
reau  of  the  Census  occupational  classification.  The  pur¬ 
pose  of  this  check  vas  to  assure  adequate  (thou^  not  neces¬ 
sarily  proportional)  representation  of  each  Bureau  of  the 
Census  category.  Another  check  vas  made  to  determine  \rtie- 
ther  representation  in  the  Interest  Inventory  vas  adequate 
for  those  occupations  in  eeich  Bureau  of  the  Census  Classifi¬ 
cation  that  are  most  frequent  in  the  population  (I950  figures). 
A  small  nimiber  of  items,  both  occupations  azid  activities,  ' 
vere  added  to  the  inventory  as  a  result  of  this  check. 

The  Pilot  Study 

In  the  fall  of  19^9  an  experimental  form  of  the  In¬ 
terest  Inventory  vas  prepared  for  use  in  a  pilot  study. 

The  experimental  form  contained  300  it«BS,  of  idiich  l64  vere 
ocei^ational  titles  and  I36  vere  activities. 

The  objectives  to  be  served  by  the  pilot  study  vere 
several  in  number.  Homogeneous  scales  vere  to  be  developed 
and  correlated  vith  existing  Inventories  to  determine  the 
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degree  to  vhloh  the  Interest  Inventory  accounted  for  the  re- 
liahle  variance  In  these  inventories.  An  eatioate  was  needr 
ed  of  the  aaount  of  tine  the  students  vould  require  to  con- 
piete  the  fom.  The  Inventory  vas  to  be  untlned  in  the 
sense  that  everyone  vould  be  alloved  to  flnieh.  This  estl- 
loate  vas  needed  in  order  to  apportion  tine  alloyances  in 
the  battery  among  the  tests  and  inventories.  The  pilot 
study  vas  also  expected  to  uncover  any  unanticipated  dif¬ 
ficulties  in  the  adalnlstration  or  vlth  the  Inventory  it¬ 
self. 

A.  Sanple  and  Administration.  The  sattple  included 
two  high  schools  in  Texas  and  a  group  of  entering  Freshmen 
at  the  University  of  Pittsburg.  The  experimental  form  of 
the  Interest  Inventory  vas  administered  to  the  entire  sam¬ 
ple  of  6^3  students.  Some  students  had  taken  the  KFR  and 

VMI-» 

others  vere  given  the  8VIB.  Table  X  presents  the  breakdovn 
of  the  number  of  students  in  each  school  and  grade  to  vbom 
the  Kuder  Preference  Becord  and  the  Interest  inventory 
vere  administered,  the  nustber  to  vhom  the  Strong  Vocational 
Interest  Blank  and  the  Interest  Inventory  vere  administered, 
and.  the  totsJ.  number  of  cases  in  each  grade. 


4 
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TABLE  VIII- 9 

Number  of  Cases  with  the 
Interest  Inventory,  Kuder  Preference  Record 
and  Strong  Vocational  In'terest  Blank 


Inventories  Administered  School  and  Grade  N 


Interest  Inventory  Univ.  P^.  Freshmen  270 

School  A  -  12  1:1^ 

School  A  -  10  163 

School  B  -  9  98 

Total  N  -  “555 

Btrong  V.I.B.  Uixlv.  Pgh.  Fresh- 

.  men  and  School  A-12  1('15 

Kuder  P.R.  School  A  -  12,  A  -  10  I63 


Adminlsttatlon  Of  the  Interest  Inventory  was  conducted 
vinder  the  guidance  of  persons  experienced  in  testing  proce¬ 
dures.  Administrators  vere  provided  vlth  a  set  of  directions 
on  'Which  -they  vere  asked  -to  indicate  the  amount  of  time  taken 
by  their  group  to  cos^>lete  the  Inventory  and  -to  comment 
upon  any  unusual  circumstances  or  problems  in  testing.  At 
f I've  minute  Intervals  the  students  were  Instructed  -to  circle 
the  number  of  -the  item  on  -which  they  vere  working. 

B.  Construction  of  the  Homogeneous  Sccdes.  A  priori 
scauLes  were  constructed  based  upon  the  specifications  for 
the  In-ventory,  a  re-view  of  se-veral  factor  analytic  studies^ 
and  the  Judgment  of  the  staff.  Correlations  between 

the  i-tems  and  the  scale  -to-tal  score  -was  used  for  -the  ^Qtirl- 
eal  woric  on  the  scales.  Faros  the  Items  allocated  to  each 
scale  a  smaller  nuaher  were  designated  as  "core"  items, 

"Core"  i-tems  were  those  -that  pre-vlous  ;rosearch  had  demon¬ 
strated  most  clearly  to  be  homogeneous.  For  example,  "core" 
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Items  In  the  Science  Scale  Included  occupations  such  as 
astronomer,  hiologist  and  chemist.  A  total  score  for  each 
scale  vas  obtained  from  the  '*core*'  Items  alone.  The  scoring 
formula  was  R-Vt200>  In  which  options  A  and  B  were  scored 
R,  and  C,  Dj  &  E,  were  scored  W.  The  addition  of  the  con¬ 
stant  avoided  the  analytic  complications  of  negative  scores. 
Each  item  was  correlated  with  the  scale  total  score  •  The 
scales  were  pUrlfled  by  rejecting  those  Items  that  did  not 
correlate  significantly  with  the  total  score . 

C.  Results  of  the  Pilot  Study.  The  data  was  analyzed 
on  the  IBM  704-  Electronic  Computer  which  scores  and  analyzes 
simultaneously.  Item  analysis  statistics  included  the  percent 
selecting  each  Item  option,  the  percent  omitting  the  Item, 
the  scale  score  mean  for  those  selecting  each  Item  option, 
the  point  blserlal  correlation  coefficient  between  each 
item  option  and  total  score  on  the  scale,  and  the  mean  and 
standard  deviation  for  each  Beetle.  This  data  was  used  to 
Judge  the  value  of  Items  for  the  Inventory  and  for  the  scales 
in  which  they  were  placed.  The  Inventory  was  reduced  from 
300  to  205  Items  on  the  basis  of  this  data. 

In  addition  to  the  Item  etnalysls  data,  correlation 
matrices  were  obtained  for  the  Interest  Inventory  scales 
separately,  and  with  the  Kuder  PR  and  Strong  VIB.  The 
correlation  matrices  are  presented  In  Tables  V^II^liOy. 

Tin-n,  and  VIII-12. 
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Table  VIII*10 

Intereet  Inventory  Seale  Interoorrelatloni  (Ma6$5) 


1  2  ■l  .  k.  S  6  7  B  Q  ■  in  11  la  It  ik  y  IS 

Scale B 


1. 

Mech .  Tec .  05 

52 

51 

17 

28 

30 

-06 

14 

43 

24 

42 

"9 

-01 

-04 

46 

9 

2. 

Skilled  Tries  5^ 

71 

10 

08 

28 

20 

36 

32 

25 

26 

42 

14 

13 

21 

69 

» 

3- 

Seienoe  51 

10 

93 

34 

22 

25 

-26 

-01 

32 

25 

26 

10 

11 

06 

05 

16 

k. 

Public  Serv.  I7 

08 

34 

84 

46 

29 

-05 

31 

13 

32 

16 

33 

22 

11 

32 

5- 

Business  Ngt.  20 

28 

22 

46 

56 

35 

15 

49 

IB 

35 

20 

28 

16 

18 

32 

35 

6. 

Conputatlon  30 

20 

25 

29 

35 

65 

27 

29 

06 

18 

12 

02 

23 

7. 

Office  Work  -06 

36 

-26 

-05 

15 

27 

83 

3? 

-l4 

07 

Ob 

13 

2d 

28 

e. 

Sales  14 

32 

-01 

31 

49 

29 

74 

07 

23 

ik 

28 

20 

24 

34 

40 

9- 

Outdoor  Rec .  43 

35 

32 

13 

18 

06 

-14 

07 

67 

48 

-12 

■09 

-10 

-02 

10. 

Sports  24 

26 

25 

32 

35 

18 

07 

25 

48 

35 

18 

14 

12 

26 

S 

11. 

Fain,  Ranch  42 

42 

26 

16 

20 

09 

-06 

14 

48 

19 

75 

02 

05 

04 

36 

14 

12. 

Ut.-Ung.  -09 

l4 

10 

33 

28 

12 

25 

28 

-12 

18 

02 

78 

63 

03 

45 

13* 

Musical  -01 

13 

11 

22 

16 

02 

13 

20 

h09 

ai4 

55 

81 

55 

00 

35 

14. 

Artistic  -p4 

21 

00 

19 

18 

03 

26 

24 

-10 

12 

63 

55 

72 

00 

39 

15* 

Labor  46 

69 

05 

11 

32 

23 

28 

34 

29 

26 

36' 

03 

00 

00 

77 

21 

16. 

Social  Serv.  05 

20 

16 

32 

35 

23 

32 

4o 

-S2 

23 

14 

45 

35 

39 

21 

55 

note:  Deolml  points  oolttad.  Fvinolpsl  diagonal o ontalns  the  spUt-test  re¬ 
liability  eorrcRited  by  the  Bpeaman-Brown  fonnalat 
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Table  /  presenta  half-test  reliability  seeffioients, 
equared  nultiple  corr.^latlon  eoeffleients,  and  uni^uenesB 
eoeffioiente  for  the  Intereet  Inventory  based  on  63^  oases. 

The  reliability  ooeffieients  appear  to  indicate  that  the 
level  of  reliability  Is  acceptable  for  noet  of  the  soalas. 

The  unlqtieneas  eoeffioiente  indicate  that  each  scale  !■  con¬ 
tributing  variance  that  differs  froai  the  other  sealas.  Tables 
VUl-lJ^  and  TIII-15 

J  paresoit  the  aultlple  correlations  and  shraaltaB  bbH- 
tlple  corralatlOBS  of  each  Interest  Inventopry  sMlas  vttii 
each  of  the  I&ider  VR  scales  and  eleven  selected  Strong  VIB 
scales  (the  Strong  scales  vere  selected  before  analysing). 

The  sire  of  these  coefficients  is  adequate  in  nost  cases. 
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Table  VlII-11 


1  4 


Interait  Inventory 

and  Xuder  Preferenoe  Record  Interoorrelatlone 


II  Soalee 

1*  Mfeoht  Tedh* 
2*  Skilled  Trde 
Science 

4*  Public  Serv* 
Bueinese  Mgt 
6.  Computation 
7«  Office  Wcric 
8«  Salee 
9*  Outdoor  Reo« 
10*  Sports 

11.  Pam,  Ranch 

12.  lilt.  ^Ijing. 
1?.  Miieloal 
14.  Artlatlc 
15*  Labor 

16.  Social  Serv. 
KPR  Seales 

17.  Outdoor 

18.  Hechanlcal 

19.  Computation 

20.  Scientific 

21.  Pereuaeive 

22.  Artistic 

25.  Literary 
24.  ^fusical 

2%  Social  Serv. 

26.  Clerical 


__T 

2 

H 

HI 

n 

7 

■nr 

nr 

nr 

nr 

ni 

nr 

n? 

s  42 

42 

49 

18 

55 

25 

-24 

21 

55 

55 

44 

-14 

11 

-07 

50 

02 

02 

08 

57 

04 

22 

5<S 

26 

27 

41 

17 

24 

29 

70 

26 

49 

02 

•30 

52 

52 

-32 

05 

44 

5^ 

24 

02 

01 

00 

06 

15 

16 

08 

30 

59 

28 

-05 

25 

51 

29 

29 

26 

17 

16 

12 

14 

.  35 

37 

52 

39 

3A 

54 

18 

46 

28 

59 

23 

26 

18 

25 

59 

29 

25 

o4 

32 

28 

25 

32 

09 

15 

10 

27 

15 

10 

17 

23 

-24 

22 

-52 

-05 

18 

25 

A5 

-24 

01 

-11 

55 

14 

28 

17 

36 

21 

5^ 

05- 

25 

46 

52 

45 

16 

22 

11 

30 

18 

22 

50 

53 

55 

26 

44 

51 

28 

09 

-24 

16 

36 

52 

-12 

-04 

-09 

.42 

-01 

35 

27 

36 

29 

39 

15 

01 

22 

56 

55 

14 

08 

08 

55 

12 

44 

41 

24 

29 

25 

10 

-11 

11 

52 

55 

-04 

00 

10 

59 

04 

-14 

17 

02 

26 

28 

27 

55 

30 

-12 

14 

-o4 

45 

59 

05 

44 

11 

24 

01 

17 

18 

15 

14 

18 

-04 

08 

00 

45 

36 

17 

29 

-07 

29 

00 

16 

25 

10 

28 

22 

-09 

06 

10 

59 

56 

05 

55 

50 

70 

08 

12 

59 

17 

17 

30 

42 

55 

59 

03 

17 

05 

14 

02 

26 

14 

-iSL 

Jl, 

-51 

-01 

12 

04 

44 

29 

35 

14 

40 

19 

38 

11 

-02 

"•OA 

-37 

-17 

60 

19 

60. 

-25 

-12 

-15 

17 

-15 

70 

27 

39 

15 

12 

—01 

-41 

-04 

54 

27 

40 

-40 

-12 

-50 

57 

-26 

-01 

-28 

24 

X7 

10 

48 

-04 

00 

-08 

05  -15 

.02 

-11. 

.24 

-16 

-02 

3<S 

-08 

87 

26 

04 

15 

-45 

-14 

4o 

21 

21 

-21 

-17 

-27 

-05 

-09 

01 

04  . 

-18 

05 

18 

-12 

14 

3<5 

-11 

-02  . 

-23 

.06 

-05 

-05 

06 

-01 

-09 

12  . 

-07 

-07 

-09 

-14 

-05 

-05 

-07 

02  . 

-01 

06 

06 

37 

-06 

.06 

-20 

00  . 

-15 

06 

09 

06 

20 

20 

-16 

-05  -22 

45 

06 

20 

-06 

23 

-12 

09  -29 

-07 

08 

-01 

23 

10 

-20 

-09  • 

-16 

26 

62 

30 

02 

15 

-5« 

-08  . 

.21 

-18 

-19 

-06 

51 

-05 

-24 

-11  . 

-10 

15 

-06 

09 

-11 

29 

"4^ 

-21  -45 

-10 

-02 

16 

12 

-44 

-22  . 

:5L 

16 

00 

07. 

-19 

16 

Notet  Decimal  points  omitted 
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Table  VIII-12 


Interest  Inventory 
axid  Strong  Vooational  Interest  Blank 
Intereor  relations  (NSAl^) 


II  Scales 

1.  Meoh.  Tech* 

2*  Skilled  Trades 
Solonoe 

A*  Public  Serv* 
Business  Mgt*  ' 

6,  Composition 

7.  Office  bbrk 
8*  Sales 

9*  Outdoor  Bee. 

10*  Sports 

11.  Farm  and  Ranch 

12.  Lit,  -Ling, 

13»  Musical 
lA.  Artistic 
1!;.  Labor 

l8.  Social  Serv. 

SVIB  Seales 
17*  Doctor 
18.  Engineer 
19*  Prod,  Manager 

20.  Pamer 

21.  Carpenter 

22.  Gffiee  Worker 
2^.  Pub.  Adminis. 

2A,  Soo.  Sol.  Teacher 
25,  Lawyer 

28.  Life  Ins*  Sales. 
27.  Musician 


,1, 

2 

F 

n 

•~7 

—I 

“T 

Z2 

“TF 

ll 

□I 

"IT 

HE 

55 

51 

18 

27 

58 

10 

lA 

Ao 

23 

A2 

.06 

-OA 

-02 

A6 

07 

55 

15 

09 

27 

2A 

A5 

3A 

26 

26 

A5 

15 

12 

20 

89 

51 

51 

15 

58 

17 

25 

-17 

-05 

26 

23 

27 

18 

17 

11 

OA 

16 

18 

09 

38 

AA 

29 

03 

29 

09 

38 

10 

5A 

22 

18- 

11 

38 

27 

27 

17 

AA 

5A 

21 

A9 

17 

38 

18 

26 

15 

X5 

52 

5A 

5<S 

2A 

25 

29 

5A 

28 

27 

07 

19 

08 

05 

-03 

-03 

25 

20 

10 

A5 

-17 

03 

21 

28 

Ao 

-OA 

10 

00 

25 

lA 

26 

35 

38 

lA 

5A 

-05 

29 

A9 

27 

Ao 

06 

25 

13 

25 

18 

21 

57 

A5 

Ao 

26 

26 

09 

17 

07 

-OA 

06 

21 

Ad 

-08 

.06 

-06 

28 

00 

25 

26 

23 

58 

58 

19 

10 

25 

21 

16 

18 

13 

11 

26 

26 

A2 

A5 

27 

10 

18 

06 

00 

15 

A8 

16 

01 

OA 

-02 

38 

15 

-06 

15 

16 

5A 

26 

05 

25 

25 

-08 

18 

01 

58 

6A 

05 

AA 

.OA 

12 

17 

22 

13 

-05 

lA 

18 

-08 

15 

OA. 

58 

58 

-oA 

3A 

-02 

20 

11 

18 

15 

-03 

26 

21 

-08 

11 

-02 

6A: 

-  ^ 

-02 

37 

A6 

69 

OA 

11 

32 

25 

35 

57 

28 

26 

38 

05 

-oA 

-02 

2A 

-2L 

JSL. 

16 

-21 

20 

36 

A3 

00 

26 

15 

AA 

3A 

37 

2A 

16 

-15 

51 

29 

00 

-01 

-38 

-20 

06 

06 

05 

15 

21 

15 

-29 

-05 

-10 

53 

15 

-02 

13 

-39 

-50 

16 

-03 

06  . 

-17 

-05 

-12 

-19 

-23 

52 

-10 

Al 

5A 

2A 

21 

-50 

-07 

16 

09 

06  . 

-06 

-02 

-10  . 

-11 

-10 

51 

-11 

Ao 

22 

09 

12 

-Ao 

-15 

17 

06 

lA : 

-lA 

-02 

-12  . 

-lA 

-11 

A5 

07 

58 

08 

OA 

20 

.22 

-15 

20 

08 

17  ‘ 

-18 

-09 

-06  . 

-05 

-11 

02 

-11 

11 

58 

50 

30 

-OA 

25 

-09 

15  • 

-02 

18 

12 

lA  . 

-lA 

16 

-12 

-26 

15 

oA 

-lA 

-17 

-58 

-2A 

-11 

-11  ■ 

-10 

12 

16 

21 

-57 

-12 

09 

-15 

50 

A9 

58 

15 

-25 

08 

OA 

17 

09 

2A 

21 

12 : 

.15 

18 

-07 

-15 

09 

A5 

5A 

08 

-15 

2A 

-10 

16  . 

-02 

52 

2A 

20 . 

-15 

30 

-2A 

-58 

05 

5A 

15 

-07 

-Al 

01 

-21 

03  . 

-19 

21 

17 

09  ■ 

-3A 

02 

r50_: 

=21. 

JO- 

-22- 

_03 

18 

-lA 

-21: 

-16 

11 

06 . 

.2A 

01 

Hotel  Decimal  points  omitted 
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tabie  yiii-13 

Interest  Inventory 

Reliability  and  Uniqueness  Coefficients 

(N-655)  ■ 


1. 

Mechanical-Technical 

•737 

■:b59 

r2 

.5S4 

^2^ 

u2 

•575 

2. 

Skilled  Trades 

♦553 

.712 

•635 

.626 

.086 

3. 

Scienoe 

•873 

•932 

•479 

.467 

.465 

4. 

Public  Service 

•727 

.842 

.382 

•367 

.475 

5. 

Business  Management 

•389 

.560 

.424 

.410 

.150 

6. 

Computational 

.483 

•299 

.283 

.368 

7. 

Office  Work 

.704 

.826 

.432 

.419 

.407 

8. 

Sales 

.582 

•736 

•39^ 

.380 

•358 

9- 

Outdoor  Recreation 

.50G 

.667 

•357 

.342 

•325 

10. 

Sports 

•  3i5 

•479 

.227 

.208 

.271 

n. 

Farm  and  Ranch 

.601 

•751 

•367 

•352 

•399 

12. 

Literary-Linguistic 

.643 

•783 

•  536 

•525 

.258 

13* 

Musical 

.680 

.810 

.388 

•374 

.436 

14. 

Artistic 

.566 

•723 

•495 

.483 

.240 

15- 

Labor 

.628 

,771 

•  556 

•  545 

.226 

16. 

Social  Service 

•379 

•  550 

•385 

•  370 

.180 

*  Corrected  by  Spearman-Brown  formula. 

**  Corrected  by  Wherry’s  Shrinkage  formula. 


TABLE  VIII-14 

Multiple  Correlation  Coefficients 
for  the  Interest  Inventory  with  the  Kuder  PR 


R 

R* 

1. 

Outdoor  . 

...  .79 

.76 

2. 

MechaniceQ. . 

...  .81 

•78 

3- 

Conq>utatlonal  .... 

...  .67 

•63 

4. 

Scientific  . 

...  .78 

•75 

5- 

Persuasive  . 

...  .63 

•59 

6. 

Artistic  . 

...  .52 

•45 

7- 

Literary  . 

...  .70 

.65 

8. 

Musical  . 

...  .64 

•  59 

9- 

Social  Service  .  .  . 

...  .54 

•47 

10. 

Clerical  . 

•  •  •  .73 

•70 

*  Corrected  by  Wherry’ s  Shrinkage  Formula 
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TABLE  VIII-15 

Multiple  Correlation  Coefficients 
for  the  Interest  Inventory  vlth  Selected  Scales 
from  the  Strong  VIB 


Strong  VIB 

R 

1. 

Doctor  . . 

...  .66 

.64 

2. 

Engineer . . 

...  .75 

.74 

3. 

Production  Manager  .  .  . 

.  .  .  .^ 

.62 

k. 

Farmer  . 

. 58 

.55 

5. 

Carpenter  . 

...  .59 

•  57 

6. 

Office  Worker  . 

.  .  .  .58 

.56 

7. 

Public  Administrator  .  . 

...  .56 

.53 

8. 

Social  Science  Teacher  . 

.  .  .  .72 

.71 

9. 

Lawyer  . 

...  .62 

.60 

10. 

Life  Insurance  Salesman 

...  .73 

.71 

11. 

Musician  . 

...  .88 

.87 

*  Corrected  by  Wherry' s  Shrinkage  Formula 
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CHAPTER  IX 

THE  GEIOTRAI,  SCHOOL  CHARACTERISTICS  QUESTIONNAIRE 

Rationale 

The  preceding  chapters  have  outlined  some  of  the  vast 
amount  of  information  about  each  student  that  has  been  col¬ 
lected  by  Project  Talent.  However,  children  are  a  product 
of  many  influences,  not  the  least  of  which  are  the  schools 
they  attend.  Thus,  in  order  to  understand  more  fully  the 
background  and  abilities  of  the  children  themselves,  it  was 
necessary  also  to  look  at  their  schools  directly.  The 
present  chapter  deals  with  one  of  the  Instruments  which  was 
developed  for  this  purpose,  the  General  School  Character¬ 
istics  Questionnaire. 

As  its  name  implies,  this  questionnaire  was  intended 
to  provide  information  about  a  variety  of  characteristics 
of  the  school  which  mij^t  make  a  difference  in  its  students 
eis  compared  to  those  of  other  schools.  It  was  filled  out 
in  each  school  by  a  person  well  qualified  to  provide  infor¬ 
mation  about  the  school  as  a  whole,  usually  the  school 


principal. 
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One  of  the  most  inqportant  usages  of  such  school  infor¬ 
mation  will  be  as  a  control  factor  in  Interpreting  student 
data.  For  example^  suppose  we  wish  to  stxidy  the  achievement 
test  scores  for  seniors  who  plan  to  be  scientists.  Many 
school  characteristics  could  affect  these  scores.  Obviously, 
the  nijunber  and  kinds  of  science  and  math  courses  offered  by 
the  school  would  affect  the  achievement  scores  made  by  its 
pupils.  Many  other  factors  could  be  inportant  and  have  to 
be  examined  before  a  valid  conclusion  can  be  drawn.  These 
mi^t  include:  size  of  school;  size  of  instructional  classes; 
percentage  of  male  teachers;  size  of  community;  location  of 
community;  characteristics  of  the  eurea  served  by  the  school; 
number  of  -grades  in  the  school;  amount  of  greiduate  training 
of  teachers;  years  of  teaching  experience  of  staff  and  eid- 
mlnistratlve  experience  of  principal.;  guidance  facilities 
available;  extra-curricular  activities  available;  grouping, 
tracking  and  acceleration-promotion  policies,  etc. 

It  may  be  that  only  a  few,  or  even  none,  of  these 
factors  has  any  measxirable  bearing  on  the  level  of  achieve¬ 
ment  test  scores  shown  by  seniors  planning  to  be  scientists. 
The  important  thing,  however,  is  that  the  availability  of 
such  infonaatlon  about  the  schools  makes  it  possible  to 
stvidy  and  measure  the  relationship  of  these  factors  to  -Hie 
abilities,  achievements,  and  behaviors  of  stvidents. 

Of  course  the  exasple  given  above  is  only  one  of  many 
uses  to'>dilch  school  data  can  be  put.  We  are  Interested  in 
studying  the  long-range  effects  of  various  school  policies 
and  characteristics  on  career  choices,  satisfcustions,  and 
successes;  in  studying  the  types  of  schools  that  develop  in 
different  types  of  communities;  and  in  knowing  some 'of  the 


characteristics  of  the  nation's  teacher$. 

Vfe  are  also  Interested  In  the  characteristics  of  our 
schools  th«ttselves:  How  old  Is  the  average  school  building? 

•A 

How  large  Is  the  average  class  In  city  schools >  country 
schools >  In  the  Norths  in  the  South?  What  percentage  of 
the  high  schools  offer  courses  In  Russian?  Hov  many  schools 
have  science  labs?  Etc.?  Throu^  Its  large  and  represent¬ 
ative  sample  of  the  nation's  hl^  schools.  Project  Talent 
has  worked  toward  providing  the  best  and  most  complete  in¬ 
formation  on  these  and  other  topics  that  has  ever  been 
available . 

Choice  of  Topics 

From  the  very  beginning,  the  General  School  Character¬ 
istics  Questionnaire  seemed  destined  to  be  of  monumental 
length.  As  the  staff  begem  to  review  the  literatiire  and  to 
develop  the  actual  questions,  the  list  grew  and  grew— and 
grew  some  more.  When  a  preliminary  form  the  lengthy 
questionnaire  was  submitted  to  the  Educational  Research 
Panel,  charged  with  the  responsibility  for  defining  appro¬ 
priate  educational  issues  for  study,  it  responded  by  pro¬ 
ducing  an  even  more  lengthy  list  of  recommended  areas  for 
study.  These  areas  are  summarized  below,  under  their  major 
categories : 

A.  Characteristics  of  the  school  which  may  influence 
educational  achievement  and  decisions. 

1.  Culture  of  the  school  and  Its  community. 

2.  Physical  features  of  the  school  and  Its 
community. 

3.  School  policies  emd  practices. 

k.  Content  and  procedures  of  courses. 
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B.  Characteristics  of  the  students  \dilch  may  Influence 
educational  achievements  cmd  decisions  (in  addition  to  those 
characteristics  measured  by  the  basic  test  battery). 

1.  Physical  characteristics. 

.2. ,  Culture  of  his  home. 

3.  Choice  of  alternatives  In  the  school  program 
open  to  him* 

k.  Motives^  values >  drives,  purposes. 

5*  Educational,  social,  civic,  and  eiiq;>loyment 
experiences. 

Subsequent  study  euid  refinement  of  the  list  of  suggested 
areas  resulted  In  the  decision  to  place  many  of  these  areas 
In  different  Instruments.  Areas  concerning  the  attitudes 
and  personal  background  of  the  student  became  parts  of  the 
Strident  Information  Blank,  discussed  In  the  preceding  chap¬ 
ter;  separate  questionnaires  (discussed  In  the  next  chapter) 
were  developed  to  cover  the  guidance  program  of  the  school, 
and  the  cheui^cterlstlcs  of  Its  counselors. 

At  each  of  the  later  meetings  of  the  Educational  Research 
.Panel,  additional  areas  for  Inclusion  In  the  Qeneral  School 
Cheuacterlstlcs  Questionnaire  were  proposed;  methods  were 
discussed  and  topics  for  elimination  were  suggested.  It 
should  be  noted,  however,  that  the  proposals  for  addition 
continued  to  out-number  those  for  elimination.  For  example, 
the  following  areaus  were  proposed  for  Inclusion  at  the 
September  1958  meeting: 

1.  Fiscal  chareu:terlstlc8  of  the  school.  Including 
various  Indices  relating  such  factors  as  college  attendance, 
ability  to  support  education,  and  socio-economic  or  cultiiral 
status  to  educational  expend! tvires . 


2.  Tea^her-pupll  ratio. 

3.  Rural-vtrban  classifications,  possibly  along  census 
lines. 

.4.  Some  measures  of  student  leadership  within  the 
school,  the  extent  of  student  peurtlclpatlon  In  planning 
educational  experiences,  the  activity  program,  student 
government,  and  the  like. 

3 1  Measures  of  the  holding  power  of  the  school  and 
of  the  age  ranges  and  average  ages  for  each  grade. 

6.  Some  estimates  of  coomiunlty  attitudes  possibly 
taken  Indirectly  from  pupil  attitudes. 

7.  Some  measures  of  educational  chsuige  In  the  school 
and  community. 

8.  Identification  of  certain  kinds  of  talent.  Including 
the  artist,  musician,  writer,  athlete,  school  leader,  etc. 

Due  to  the  Increase  in  number  of  areas  to  be  considered, 
one  of  the  major  problems  in  the  development  of  the  question¬ 
naire  was  pruning  the  number  of  questions  asked  to  a  number 
which  a  principal  might  reasonably  be  e3q>ected  to  answer. 

It  was  decided  that  questionnaire  form  would  provide  the 
greatest  versatility,  and  that  most  questions  should  be 
placed  in  multiple  choice  form  In  order  to  minimize  the 
principal's  task.  After  some  pruning,  the  staff  produced 
an  extensive  questionnaire  for  the  review  of  the  Educational 
Research  Panel.  Recommendations  for  further  reduction  In 
length  were  requested,  and  many  genersd  recommendations  and 
specific  suggestions  on  all  aspects  of  the  questionnaire 
were  received  from  the  Panel. 

For  example.  It  was  suggested  that  more  questions  be 
added  on  community  facilities,  the  questions  on  school 
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philosophy  he  revised  or  dropped^  and  the  section  on 
courses  offered  In  the  school  he  revised.  Additional 
fiscal  data  were  recomnended— per-pupll  eaqpenditure, 
library  facilities  and  ejqpendltxires, .  etc. 

!Pie  Bevelopmeiit  and  Tryout  of  the  Experlneatal  Fonn 

Based  upon  staff  research  and  the  reviews  and  sug¬ 
gestions  of  the  Educational  Reseeo^ch  Janel,  a  tryout 
quedtlonnalre  was  prepared.  This  questionnaire  was  sent 
to  seven  hl£^  school  principals  In  several  Georgia  cc^ 
muni ties  for  tryout.  While  this  was  not  Intended  to  he  a 
representative  sample.  It  was  set  up  to  cover  large  and 
small  schools  of  hoth  rural  euid  urban  character.  The  ccan- 
ments ,  criticisms,  and  suggestions  of  these  principals  eind 
of  the  Indlvldxjal  Panel  members,  along  with  further  stxxdy 
by  the  central  staff,  formed  the  basis  for  a  new  revision 
of  the  questionnaire. 

The  newly  revised  questionnaire  was  submitted  to  the 
Panel  for  a  final  review  at  Its  meeting  In  October  1959* 

At  this  time  the  Panel  was  eisked  to  submit  detailed  sug¬ 
gestions  with  respect  to  form  of  the  questionnaire.  The 
Panel  approved  with  some  suggestions  the  general  content 
and  form  of  the  questionnaire.  Including  the  proposed  Inter¬ 
vals  for  the  various  Item  choices.  Thd  recommendations 
Included  proposals  for  revising  the  order  of  the  questions, 
revising  the  course  listings,  and  some  specific  suggestions 
regarding  particular  Items. 

The  suggestions  and  recomendatlons  of  the  October 
Panel  meeting  were  then  Incorporated  with  the  revised 
questionnaire  to  make  the  final  form  of  the  questionnaire. 


IX-8 


* 


* 


response  such  as  nuhber  of  school  days  In  the  school  year^ 
per-«pupll  expenditure^  cmd  enrollment  data. 

In  the  course  listing  section,  courses  vere  grouped 
by  broad  subject  matter  areas.  For  each  of  the  courses 
listed,  principals  were  asked  to  write  one  of  the  following 
code  numbers  In  the  peurentheses  In  front  of  the  course: 

k  —  This  course  is  offered  and  is  compulsory  for 
all  students. 

3  —  This  course  is  offered  and  is  conpulsory  for 
for  all  college  preparatory  students,  but 
not  for  all  students. 

2  —  This  course  is  offered  and  is  corapvilsory 
only  for  some  group  of  students  other  than 
college  preparatory  students. 

1  —  This  course  is  offered  as  an  elective  only. 

0  --  This  course  is  not  offered. 

■A  Picture  of  Three  Schools.  The  final  Questionnaire 
is  too  long  to  reproduce  here,  but  the  kinds  of  information 
included  can  be  Illustrated  by  comparing  some  of  the  actual 
data  supplied  by  three  different  schools.  The  three  examples 
given  below  are  not  presented  as  being  typical  or  repre¬ 
sentative,  but  were  sinqply  chosen  essentially  at  random  from 
the  Project  files  for  the  sake  of  illustration.  These 
examples  show  the  type  of  descriptive  picture  which  the 
Questionnaire  material  provides.  These  descriptions  do  not 
include  all  of  the  information  available  about  these  three 
schools  but  Illustrate  the  areas  of  coverage  contained  in 
the  Questionnaire. 

School  1.  Ihis  is  a  large,  metropoliteui  public 
school  with  a  total  enrollment  for  grades  9,  10,  11,  and  12 
of  1795  "boys  and  l880  girls.  It  is  a  fully  accredited  four- 
year  hi^  school  operating  on  a  school  year  of  192  days, 
each  composed  of  seven  45 -minute  periods.  Classes  average 
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Ihe  Final  Form 

The  folldtrlhg  sectioil  preaents  e  bicief  description  of 
the  final  foxiii  Of  the  General  School  Characteristics 
^Questionnaire . 

Content.  In  general^  the  final  forft  of  the  General 
Sctool  Characteristics  Questionnaire  is  arranged  in  a  nunber 
of  Sections.  The  first  Section  deals  yith  the  school  and 
Its  policies^  prs^ctlces,  and  plant.  Questions  Included 
here  concern  type  of  school,  special  classes,  grading  and 
advancement  policies,  condition  of  the  plant,  average  class 
size,  etc.  The  next  section  deals  vith  number,  training, 
and  characteristics  of.  the  teaching  stsiff .  Then  come 
questions  pertaining  to  the  students ;  enrollmenii  dropout, 
college-going,  remedial  work,  etc .  Next  is  a  section  con¬ 
cerning  characteristics  of  the  community,  such  as  PTA. 
activity,  type  of  area  served  by  the  school,  per-pupll 
expenditures,  ethnic  background,  and  oonDOunity  facilities. 
The  final  section  of  the  main  Questionnaire  concerns  the 
age,  experience,  and  training  of  the  principal  himself. 

At  the  end  of  the  Questionnaire  is  an  extensive  listing  of 
high  school  courses  idiere  the  principal  is  to  Indicate  the 
courses  offered  in  his  school. 

■  Format.  Vlrtiially  all  of  the  Questionnaire  is  placed 
in  the  multiple  choice  form  so  that  the  principal  can  indi¬ 
cate  his  answer  to  the  question  by  marking  one  (or  In  some 
csuses  several.)  of  the  indicated  choices .  A  nuaiber  of 
questions  provide  an  oppoz*tunlty  to  write  in  and  explain 
an  "Other”  response  not  covered  by  the  Indicated  choices. 

A  very  few  questions  were  set  up  as  fill-in  questions. 
These  are  confined  to  questions  requiring  a  numerical 
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33-38  student^  who  are  assigned  2-3  hovirs  of  homework  per 
day.  This  school  provides  several  kinds  of  recognition  for 
superior  work;  an  sidvauiced  cvirrlcvilum  in  sill  courses  for 
superior  students;  and  special  separate  classes  for  mentally 
retarded,  read.lng  and  speech  difficulties,  rapid  learners, 
and  special  talents.  Numerical  grsules  are  assigned  primarily 
on  level  of  subject  matter  achievement  and  are  used  as  the 
principal  basis  for  assigning  students  to  instructional 
classes.  Simmer  school  and  adult  education  courses  are 
offered.  Enrollment  was  down  somewhat  over  the  preceding 
year,  dally  absenteeism  averages  and  the  Administrative 

Assistant  who  filled  out  the  (Questionnaire  for  review  by  the 
principal  felt  that  the  school  needs  additional  personnel  in 
administrative,  supervisory,  guidance,  teaching,  and  clerical 
positions . 

The  school  building  ‘is  20-2U  years  old  but  was  renovated 
less  than  three  years  ago.  It  is  equipped  with  a  library  of 
more  than  2T00  books,  cafeteria,  gym,  athletic  field,  audi¬ 
torium,  movie,  radio,  television,  phonograph  and  public 
address  system  equipment,  various  laboratories,  etc.  A  wide 
variety  of  extra-curricular  activities  and  clubs  are  avail¬ 
able. 

All  of  the  more  than  27  teachers  are  full-time,  end 
50-591^  of  them  are  men.  Virtually  all  of  the  teachers  teve 
a  Master's  degree,  sdl  are  fully  state-certified,  and  are 
spending  at  least  half-time  teaching  in  their  major  areas  of 
jn^paration.  Beginning  teachers  start  at  $it^900-#i-900  per 
year,  turn-over  last  yesr  was  3-51^#  and  the  current  staff 
averages  more  than  15  years  of  full-time  teaching  experience. 

Transfers  last  year  account  for  less  than  4^  of  the 
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enrollment;  less  than  9^  of  the  boys  and  girls  entering 
10th  grade  drop  out  before  graduation,  \rtille  70'- 79?^  go  on 
to  college.  Delinquency  rate  Is  about  1^,  and  less  than 
of  the  students  take  remedial  math  or  remedial  reading 
or  English,  and  only  take  repeat  work  in  summer  school. 

While  no  citizens'  group  has  studied  the  school  recently, 
more  than  63^^  of  the  parents  are  members  of  the  PSk,  which 
meets  about  once  every  five  weeks.  The  area  served  by  the 
school  is  about  equally  apartments  and  homes  in  a  moderately 
e^qpenslve  urban  residential  area.  ,Per-pupil  expendltTires 
last  yesir  were  about  $560.  Memy  community  facilities  such 
as  concerts,  theater,  library,  musem.  Scouts,  swimming, 
etc . ,  are  readily  available . 

Hie  principal  of  this  school  is  a  man  of  55-59#  with 
15-19  years  eijperience  as  a  principal;  he  has  been  principal 
of  this  school  6-8  years.  He  holds  a  Doctor's  degree  and 
has  had  more  than  50  credits  in  education  courses. 

Hie  courses  offered  in  this  school  cover  a  wide  range 
of  commercial  and  college  preparatory  subjects;  a  few  voca¬ 
tional  courses  and  shops  are  also  offered. 

School  2.  This  is  a  small,  mldwestern  public 
school  with  a  total  enrollment  for  grades  9#  10,  11,  and  12 
of  96  boys  and  107  girls.  It  is  a  state-accredited  12 -year 
school,  operating  on  a  school  year  of  178  days  composed  of 
8  or  more  45-mlnute  periods  each  day.  Classes  average  24-29 
students,  who  cure  assigned  1-2  hours  of  homework  a  day,  emd 
have  9  or  more  study  halls  per  week.  This  school  provides 
special-group,  separate  classes  only  for  blind  students,  has 
no  accelerated  curricula,  and  recognizes  superior  achieve¬ 
ment  only  through  a  "Dean's  List"  or  equivalent,  and  the 
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privilege  of  taking  additional  vork.  Numerical  grades  are 
assigied  primarily  on  the  basis  of  subject  miatter  achieve¬ 
ment  and  are  used  in  oraablnatlon  with  tests  and  staff  Judg¬ 
ment  to  make  class  assignments.  Tbere  is  no  sumner  school 
prograffl>  and  only  non-credit  vocational  courses  are  offered 
for  adults.  Enrollment  is  about  the  same  as  last  year;  with 

average  dally  absenteeism.  Personnel  needs  Include 
supervisory;  guidance;  clerical;  and  Janitorial. 

The  school  building  is  ^-9  years  old  emd  received 
painting  or  renovation  less  than  3  years  ago.  It  has  a 
llbarary  of  1500-1T99  bookS;  cafeteria;  gym, .  athletic  field, 
and  audltoriviffl;  movie;  radio,  phonograph  and  public  address 
equipment;  science  labs,  etc .  Extra-curricular  activities 
sure  not  as  broad  and  vauried  a.8  for  Bchool  1  but  Include 
Intramural  athletics  (boys  and  girls),  band,  school  papers, 
dramatics,  subject  matter  clubs,  dances,  and  boys'  inter- 

school  athletics. 

1 

In  contrast  to  School  1,  there  is  no  homogeneous 
grovq)lng  and  no  acceleration  is  permitted;  however,  like 
School  1,  there  are  several  tracks.  There  are  9-11  full¬ 
time  teEu:hers,  of  whom  70-79^^  are  men.  All  of  these 
teeichers  have  a  Beichelor's  degree  and  none  has  any  hl^er 
degree,  only  one  or  two  having  emy  grsduate  training.  All 
of  the  teachers  axe  state-certified,  and  average  15  years 
or  more  of  full-time  teaching  esgperlence.  Beginning  teachers 
start  at  $3500-^3999  per  year,  aM  t\im-over  last  year  was 
zero. 

Transfers  last  year  were  less  than  while  drop-out 
from  10th-12th  greuie  averaged  10-19^t.  Only  10-13$  of  the 
boys  emd  0-S$  of  the  girls  go  on  to  college;  delinquency 
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rate  vas  about,  1^. 

Bb  citizens'  group  has  recently  studied  the  school, 
and  only  7-13?^  of  the  parents  are  members  of  the  PEd, 
idiich  meets  monthly.  The  school  serves  a  rural  farm  area 
in  shich  the  residences  are  primarily  moderate-priced  homes 
about  25-29  yeare  old.  Per-pupil  expenditures  last  year 
were  about  $233*  Community  facilities  include  library, 

4-H,  ,  Scouts,  ^d  public  recreation  center. 

The  principal  of  the  school  is  a  man  of  50-5^  who  has 
had  all  of  his  teaching  and  administrative  experience  (15-19 
years)  in  this  school.  He  holds  a  ^-yeeur  degree  with  50  or 
more  credits  in  education. 

The  courses  offered  are  those  of  a  comprehensive  high 
school  but  are  considerably  less  varied  than  those  of 
School  1,  No  fine  ajpts  are  offered  emd  Latin  is  the  only 
language  offered,  as  coinpared  to  Spanish,  French,  Latin, 
emd  Hebrew  in  School  1.  Four  agriculture  courses  are 
offered,  however. 

School  3.  This  is  a  moderate  sized,  non-nubllc 
school  located  in  the  largest  city  of  a  western  state.  It 
has  a  toteG.  enrollment  of  196  boys  and  352  girls  in  the  top 
four  of  its  12  grades.  It  is  fully  accredited  and  operates 
on  a  177-day  school  year,  with  6  periods  of  55  or  more 
minutes  a  day.  Classes  average  27-29  students,  who  are 
given  2-3  hours  per  day  of  homework  and  no  study  halls. 
Special  separate  cleusses  are  provided  only  for  reading 
difficulty  and  math  difficulty;  and  "Dean's  List",  special 
awards,  and  accelerated  math,  science,  and  language  curricula 
are  provided  for  superior  students.  Numerical  greuies  are 
assigned  on  primarily  the  basis  of  subject  matter  achievement 
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and  are  used  vlth  test  aM  staff  Jud^^nt  to  make  class 
assl^pments  .  Students  can  taka;  l>oth  nev  and  repeat  vork  in 
sunDMo*  school,  hut  no  sidult  education  is  offered.  In  con¬ 
trast  to  Schools  1  and  2,  religious  education  is  contained 
In  the  regular  curriculun.  XnrollBent  Is  about  the  sane  as 
last  year,  vrlth  dally  absenteeism  averaging  6-8^.  Adminis¬ 
trative,  supervisory,  guidance,  and  clerical  personnel  are 
needed. 

The  building  Is  less  than  five  years  old  and  Is  equipped 
with  a  library  of  mere  than  27CX)  books.  It  has  essentially 
the  sane  equipment  as  Schools  1  and  2,  .  Sxtra-currlcTilars 
Inclxide  school  government,  ma^izlne,  athletics,  subject 
matter  clubs,  glee  club  and  band,  drama,  debate,  and  religious 
club. 

Heiny  courses  axe  grouped  homogeneously  and  there  are 
.  several  tracks,  but  no  acceleration  Is  permitted. 

There  are  about  21-23  full-time  teeushers  and  9*11 
regular  peort-tlme  teachers;  only  10-19^  of  the  full-time 
teachers  are  men,  and  about  12-l4  of  the  full-time  teeushers 
have  a  Beudielor's  degree,  while  9-11  have  a  Master's  degree. 
About  90-99^  are  state-certified,  emd  only  30-^9%  are  teach¬ 
ing  In  their  major  area  of  prepeo:atlon.  Starting  salaries 
axe  A35OO-A3999  per  year,  and  average  years  of  full-time 
teaching  experience  sure  12-lk. 

Transfers  last  year  accounted  for  3-9^  of  enrollment; 
both  delinquency  and  drop-out  rates  were  nil.  However,  only 
20-23$  of  the  boys  and  1|0-491(  of  the  girls  go  on  to  college. 
Less  than  of  the  students  take  repeat  or  remedial  suiOBer 
work,  but  5-9?t  are  in  remedial  math  emd  10-l4^6  In  remedial 
residing  or  English. 
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No  citizens'  group  has  recently  studied  the  school, 
hut  more  than  631^  of  the  parents  sure  members  of  the  monthly 
EQl.  Pupils  attending  the  school  come  fpom  areas  scattered 
over  the  entire  city  and  from  all  types  of  homes  of  ail  ages . 
Per-pupll  e^ndlture  last  year  (not  eonparahle  to  public 
schools  for  various  reasons)  was  reported  as  ^00.  Public 
facilities  Include  library,  museum,  concerts,  and  Scouts. 

The  principal  of  this  school  Is  a  woman  35-39  years  of 
eige  who  has  had  15-19  years  of  teaching  experience,  less 
than  5  years  as  principal,  and  Is  In  her  first  year  eus 
principal  of  this  school.  She  holds  a  Master's  degree  and 
has  had  1K)-49  credit  hours  of  education  courses. 

Cotirses  offered  are  those  of  a  general  comprehensive 
high  school.  Latin,  French,  and  Spemlsh  are  given,  but 
very  little  Is  offered  In  Industrial  arts  and  nothing  In 
trade  eind  vocational  education.  Several  religion  courses 
are  offered,  as  are  music  emd  fine  arts. 

A  Final  Word.  It  was  necessary  to  develop  a  single 
questionnaire  to  be  used  for  all  schools  In  the  study.  In 
practice,  some  problems  resulted  from  this  approach.  For 
exanple,  some  questions  In  the  final  form  were  well  phrased 
for  Junior  hl£^  schools;  In  some  cases,  schools  In  some  of 
the  special,  testing  were  not  secondary  schools  at  all.  How¬ 
ever,  a  great  majority  of  these  difficulties  have  been 
eliminated  by  contacting  a  few  schools  for  more  Information 
and  by  careful  examination  and  coding  of  responses.  When 
necessary,  the  aid  of  the  Regional  Coordinators  waa  used  to 
help  cosq^lete  the  questionnaires  emd  clarify  them  after  they 
were  Initially  filled  out. 

Finally,  It  should  be  noted  that,  broad  as  the 
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Infozioatlon  requested  In  the  {^oestlonnalre  may  be.  It  forma 
only  a  amall  part  of  those  ia^ortaat  qpestlona  idU.eh  mi|^t 
have  been  asked.  As  pointed  out  before,  the  most  difficult 
task  vhleh  faced  the  staff  (and  the  Fanel)  concezulng  this 
(Questionnaire  vas  not  'Nhat  to  Include,  but  what  to  exclude. 
Seelslons  vere  made  In  this  respect  on  the  basis  of  those 
Items  of  Information  idilch  appeared  most  relevant  to  the 
analysis  of  the  other  data  being  collected;  those  vhloh 
seemed  most  laqportant  In  their  oen  Fl£d^t;  ,and  those  iihlch 
appeared  to  be  reasonably  accessible  to  the  school  principal. 
It  Is  unfortunate  but  unavoidable  that  the  data  for  many 
important  studies  were  thus  left  out  In  order  to  make .  room 
for  data  considered  more  important  or  more  appropriate  by 


the  Panel  and.  the  staff 
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CHAPXBt  X 

THE  OUISIUICE  IROCBAM  OJESnOanUORE 
AND  THE  COUNSELOR'S  QUESTIONNAiRE 
Early  In  the  plazming  atagea  of  the  project  a  ainc^e 
queatlonnaire  vaa  conaldered  \ihlch  inclttOed  (pieaticna  on 
guidance  and  counaellng  aa  a  part  of  the  general  qpieatlon- 
naire  to  be  cooplerted  by  the  principal  at  each  achool. 

Thla  approach  vaa  aoon  abandoned  vvon  the  reccanendationa 
of  our  adviaory  panela  (Educational  Reaearch  Panel  and  the 
Guidance  and  Counaellng  Panel).  There  were  aeveral  reaaona 
for  thla.  Firat,  the  YoluDe  of  infoxnatlon  that  vaa  wanted 
from  each  achool  aeemed  to  be  too  large  to  be  anavered  by 
the  principal.  Therefore,  the  ataff  and  panela  felt  that 
nany  gueatlona  ai|^  be  retained  if  aoneone  other  than  the 
achool  principal  vaa  naked  to  coaqplete  queationnalre  mater¬ 
ial.  Sncood,  it  aewwd  poaaible  that  the  guidance  officer 
in  eadh  achool  aluht  be  better  infoamad  than  the  principal 
on  many  ot  tha  guidance  progma  dataila.  Third,  guidance 
and  counaeling  waa  one  part  of  the  achool'a  program  on 
ahlch  it  aeemed  deairable  to  gather  more  detail  alnce 
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guidance  people  are  those  for  vbom  Project  Valentis  re¬ 
search  efforts  would  he  likely  to  have  the  latest  meaning. 
And  fourth,  current  information  on  guidance  programs  and 
on  counselors  In  o\ir  hi^  schools  vas  deemed  an  appropriate 
topic  for  the  study.  The  guidance  field  had  heen  expanding 
(julte  rapidly  suggesting  that  information  gained  from 
earlier  studies  would  he  out  of  date* 

It  seemed  deslrahle  to  gather  information  on  guidance 
programs  for  several  reasons.  We  vented  to  investigate  on 
a  national  hasis  the  ways  in  vhteh  hic^  schools  provide 
for  guidance.  Questions  about  the  school's  facilities  for 
guidance,  the  nuiaber  of  counselors  enq;loyed,  eidmlnlstra- 
tive  arrangements  for  guidance,  the  extent  to  which  tests 
are  used,  and  other  topics  seemed  relevant.  We  wanted  to 
learn  about  the  ways  in  which  guidance  programs  are  inte¬ 
grated  into  school  programs.  In  order  to  do  this,  we  would 
have  to  have  information  that  would  enable  us  to  compare 
the  school  characteristics  with  guidance  program  character¬ 
istics.  An  example  of  such  a  coaqparlson  ml^dit  Involve  com¬ 
paring  school  size  with  the  number  of  counselors  employed. 

With  our  data,  we  would  he  able  to  compare  schools  on  their 
guidance  programs  as  well  as  on  other  characteristics. 
Comparisons  of  this  sort  mlc^t  prove  useful  to  admlnlstra^ 
tprm  ill  muggestdng  needed  changes. 

Wh  wanted  to  correlate  information  on  the  guidance 
program  vlth  the  student's  test  scores  and  questionnaire 
responaea.  Va  thouf^t  it  desirable  to  he  able  to  investigate, 
other  factors  eqpal,  if  guidance  has  a  measurable  correlation 
with  students'  test  performance,  aspirations,  or  plans  for 


college.  Ve  vanted,  too,  to  correlate  data  on  guidance 
programs  cuid  procedures  vlth  some  criteria  of  student 
'behavior  including  quitting  hlfid^  school,  at'bending  college, 
oh-taining  a  scholarship  or  a  student  loan,  or  choosing  an 
appropriate  vocation.  Research  on  the  last  tvo  topics 
wovild  help  to  clarify  the  role  that  guidance  plays  In  the 
development  of  our  high  school  students.  For  exazi5>le,  it 
mlfijit  he  expected  that  if  guidance  is  being  effectively 
carried  out  in  our  schools  that  'the  number  of  students 
vho  quit  school  mlg^t  decrease,  that  deserving  students 
would  be  helped  to  gain  scholarships  or  student  loans,  and 
that  students  would  choose  colleges  and  'vocations  more 
appropriately. 

The  Project  Talent  Study  of  Guidance  and  Counseling 

The  Guidance  Program  Questionnaire  and  the  Counselor's 
Questionnaire  were  developed  in  about  the  same  'way  as  the 
School  Characteristics  Questionnaire  described  in  the  pre> 
vlous  chap'ter.  The  Counseling  and  Guidance  Panel  recom¬ 
mended  topics  and  issues  for  study.  The  staff  reviewed 
-these  recommendations  In  the  lif^t  of  cxurent  research  and 
the  objectl-ves  of  the  Project  and  submitted  preliminary 
-versions  of  the  questionnaires  to  the  panel  for  review  and 
comment. 

The  first  questionnaire  submitted  to  the  panel  included 
questions  about  -the  guidance  program  and  about  -the  counse¬ 
lors  In  a  single  form.  After  reviewing  this  form,  staff 
and  panel  agreed  that  -the  questions  about  the  coimselors 
Should  be  placed  on  a  separate  form.  In  this  way,  each 
counselor  could  answer  questions  about  his  own  education 
suad  experiences.  The  newly  revised  questionnaire  was 
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svLbai4.tted  to  tho  Facel  for  a  floal  review  at  its  meetijig 
In  October  1^59*  suggestions  and  recommendations  of 
the  October  panel  meeting  were  then  incorporated  with  the 
revifiqd  questionnaire  to  malce  the  final  form  of '  l^e  gues^ 
tlonw^ire. 

Each  school  was  asked  to  complete  two  questionnaires^ 
the  Gnidsnce  Program  Questionnaire  (GPQ)  and  the  Counse¬ 
lor*  s  Qnestlonnalre  (CQ) .  The  GPQ  was  completed  by  the 
guidance  officer  or  the  prlnclpal>  if  the  school  had  no 
officer.  The  CQ  was  completed  by  each  counselor 
in  the  school  >dio  devoted  twenty  percent  or  more  of  his 
time  to  guidance  and  counseling  duties.  The  GPQ  included 
2k  pa^s  of  questions  and  over  200  items  of  information. 

The  CQ  InclTided  six  pages  of  q'uestlons  and  about  7^  items 
of  information.  In  most  cases  the  questionnaires  were 
pre*coded,  but  write-in  responses  were  permitted  for  ques¬ 
tions  on  idilch  choices  other  than  those  presented  mi^t  be 
possible.  We  felt  that  the  variety  of  school  practices 
were  not  necessarily  com^aetely  known  at  this  time.  There¬ 
fore,  vell-docvaaented  choices  were  presented  in  pre-coded 
form,  but  the  option  to  write  in  another,  response  was  pre¬ 
sented.  Answers  were  marked  directly  on  the  questlozmalres. 
Upon  return  to  the  Project  office,  each  questionnaire  was 
reviewed  for  cooqileteness.  Incomplete  questionnaires  were 
returned  to  the  school  for  completion.  Hext  the  quest lon- 
nadrea  were  coded  and  the  data  were  punched  on  IBi  cards 
for  processing. 

A  variety  of  item  types  was  used,  including  multiple 
choice,  yes-no,  rating  scales,  check  list,  write-in,  and 
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paragraph.  Following  are  some  sasqple  Items: 

How  many  years  ago  did  your  school 
organize  a  guidance  program? 

(  )  1.  Less  than  1  year  ago  (this  school  year) 

(  )  2.  1  year  ago 

)  3«  2  years  ago 
)  3  years  ago 

)  5*  ^  years  ago 
1  6.  ^  years  ago 
)  7.  6  or  7  years  ago 
)  8.  8  or  9  years  ago 
)  9*  10' to  15  years  ago 
(  )10.  l6  years  ago  or  longer 

11.  For  each  of  the  following,  how  often  floes 
the  counselor  call  the  student's  parents 
for  a  coxuTerence?  Mark  yoiir  answers  as 
follows: 

1.  Always 

2.  Frequently 

3*  Occasionally 

4.  Rarely 

5.  Never 

a.  _ For  dlsclplinarv  repsons 

grades  ..  , 

The  topics  on  which  information  was  requested  were  as 
follows: 

The  Guidance  program  Questionnaire: 

1.  Scope  of  the  program.  This  section  asked  whether  or 
not  the  school  had  a  guidance  program.  If  there  was 
a  program  in  the  school,  further  questions  were 
asked  about  the  size  of  the  guidance  staff,  ade¬ 
quacy  of  facilities  for  guidance,  and  referral 
facilities  In  the  community. 

2.  Types  of  aids  and  guidance  provided  by  the  counselors 
and  the  program.  This  Is  partly  a  matter  of  problems 
brou^t  to  counselors  by  the  students  and  partly  a 
matter  of  the  counselor  scheduling  conferences  with 
students  and  parents.  It  also  Includes  special 
courses  such  as  occupations,  and  means  of  imparting 
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educational  and  vocational  Infozinatlon. 

3>  Past  grovth  of  the  program,  in  this  section 
questions  are  asked  about  expansion  of  the 
guidance  pxograo  in  recent  years. 

4.  Plans  for  expansion.  This  section  is  similar 
to  the  pzevious  one  but  asks  about  additions  to 
be  made  to  the  guidance  program  in  the  next  fev 
years. 

The  testing  program.  This  section  Is  largely 
concerned  with  nationally  standardized  tests 
and  inventories.  There  are  many  kinds  of  tests 
and  inventories  including  the  well-known  intelli¬ 
gence  tests,  aptitude  batteries,  achievement 
batteries.  Interest  Inventories,  adjustment  in¬ 
ventories,  etc.  In  addition,  there  are  lesser 
known  tests  of  special  aptitudes  such  as  those 
used  to  assess  aptitude  for  art  or  music. 

EqxmuLly  important  are  the  express  purposes 
for  '(dilch  tests  are  used.  The  same  test  may  be 
used  to  provide  Information  to  st\idents  and  peirents 
on  school  progress,  educational  potential,  or 
occupational  potential.  Similarly,  the  same  test 
might  be  used  to  evaluate  the  progress  of  the 
school,  to  assign  students  to  currlcvila,  or  to 
provide  information  to  prospective  enployers, 
colleges,  or  scholarship  agencies. 

The  Counselor’s  (^stlonnalre: 

1.  Duties  performed.  This  section  Included 
questions  on  the  proportion  of  time  spent  in 
guidance  and  counseling  duties  versus  other 
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functions,  such  as  teaching,  administration,  and 
the  like.  Information  vas  obtained  on  the  xnropor- 
tion  of  their  guidance  time  spent  in  various 
duties,  su(di  as  counseling,  testing,  staff  dis¬ 
cussions,  preparing  reports,  etcv 

2.  Education  and  training.  Questions  Included  de¬ 
grees  obtained,  coursevork  related  to  guidance 
and  counseling,  and  how  their  training  in  gui¬ 
dance  and  counseling  was  obtained  (l.e. ,  throuf^ 
college,  the  school  system,  or  on  the  Job). 

3*  E^^rlence.  Questions  were  asked  about  the 
number  of  years  of  experience  in  teaching  and 
In  guidance  and  counseling. 

k,  Rrafesslonal  certification,  participation,  and 
interest.  Professionalism  in  the  guidance  field 
may  be  reflected  In  a  number  of  ways.  Questions 
were  asked  about  state  or  local  certification, 
professional  organizations  of  which  they  are  a 
member,  meetings  of  professional  societies  which 
they  have  attended,  and  professional  magazines 
which  they  have  read. 

3.  Objectives  of  guidance  and  counseling.  This 
question  ex^ored  the  counselor's  point  of  view 
on  the  In^rtant  contributions  he  can  make  to  the 
lives  of  his  students. 

6.  Paragraphs.  Two  quest  lens  were  included  for 
which  the  counselor  vas  asked  to  pirovlde  his 
views  at  length.  One  question  asked  the  cotnselor 
to  list  the  activities  that  shovild  ideally  be 
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included  In  a  guidance  program,  and  the  amount 
of  time  to  he  devoted  to  each.  The  second  ques¬ 
tion  deacrihed  a  hypothetical  "case  study”  and 
asked  the  counselor  to  tell  hov  he  voiild  handle 
the  situation. 

7.  Other  questions  asked  shout  the  counselor's 
sex,  age,  and  salary. 

The  analysis  of  the  data  involves  statistical  com¬ 
putations  from  vhlch  useful  Information  can  he  derived. 
Among  the  atatistlcal  analyses  that  vlU  he  perfpzmed  are 
the  follovlng: 

1.  Ve  Indited  frequency  dlstrlhutlons  or 
"popxilatlon  estimates”.  A  ”populatlon 
estimate"  approximates  the  frequency  dis¬ 
tribution  in  the  nation  from  the  distrihu- 
tion  in  the  sanq>le.  In  Project  Talent,  we 
drew  a  ^  percent  sample,  therefore  all  of 
the  population  estimates  will  he  based  on 
this  sasq>le.  Some  examples  of  the  infor¬ 
mation  we  plan  to  obtain  from  the  Guidance 
Questionnaire  and  the  Counseling  Question¬ 
naire  using  this  method  Include  estimates 
of  the  number  of  schools  that  have  formal 
guidance  programs,  the  numiber  of  full-time 
and  part-time  counselors  In  the  country  and 
the  number  of  coimselora  with  differing  years 
of  experience.  The  same  type  of  analysis  can 
also  he  made  for  regional  areas  and  for  urban- 
rural  areas  within  the  country. 
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2.  Cross'tabulatlons.  Questions  can  loe  cross- 
tabulated  in  order  to  gain  inore  detailed 
Infoxnatlon  about  guidance  prograiDa  and 
counselors.  For  exanqplef  one  analysis 

ve  anticipate  conducting  vlll  conqpare  the 
school  enrollment  vlth  vhether  the  school 

a  guidance  program.  From  this  comparison; 
ve  vould  be  able  to  learn  vfaether  larger 
schools  have  guidance  inrograms  more  fre^ 
quently  than  isnaller  sdxoolS;  or  vbether  the 
size  of  the  school  makes  any  difference  at 
all.  In  the  Counselor* s  Questionnaire,  ve  plan 
to  ccaipBre  such  things  as  the  counselor's  age 
vlth  his  college  coursevork  in  guidance. 

3.  Proportions  or  percents.  Anong  the  propor¬ 
tions  that  vlll  be  confuted  are  the  propor¬ 
tion  of  the  schools  that  have  guidance  pro¬ 
grams,  the  proportion  of  counselors  of  each 
sex,  the  proportion  of  counselors  vlth  the 
master's  degree,  and  the  proportion  of 
counselors  In  each  region  of  the  coimtry. 

Many  others  vlll  be  Included. 

4.  Correlation.  Ve  vlll  calc\ilate  coefficients 
of  correlation  vhich  vlll  Indicate  the  de¬ 
gree  to  vhldi  ceirtaln  guidance  or  counselor 
characteristics  are  found  together.  Toae  . 
exaaple,  it  vlll  be  possible  to  determine 
the  extent  to  vhich  large  sdiools  have  gui¬ 
dance  programs  vlth  many  counselors.  These 
calculations  permit  consideration  of  many 
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characteristics  at  once  Instead  of  indivi¬ 
dually.  Resulte  from  studies  of  relatloncdilps 
am:  often  move  enll^tenlng  vhen  the  hehavlors 
themselves  are  quite  complex.  Methodology 
vUl  also  Involve  uSe  of  multiple  correlations 
azxd  partial  correlations. 

With  these  analytical  inethods>  ve  plan  to  study  some 
selected  aspects  of  guidance  and  counseling  resources  in 
American  hl£^  schools.  This  stiu^  vUl  provide  data  on 
how  tl^  nation  stands  a^t  the  time  of  testing  on  eac^  of 
the  Characteristics  of  guidance  programs  and  counselors 
mentioned  in  the  outline  of  topics.  This  Information 
should  he  useful  to  leaders  In  education  wd  guidance 
for  evaluating  needs  for  counselors,  for  comselor 
tralnihgi  and  for  guidance  facilities.  In  addition,  the 
information  mlj^t  be  used  by  school  administrators,  prin¬ 
cipals,  and  guidance  officers  as  an  aid  for  evaluating  their 
own  schools’  program  of  guidance  by  comparing  themselves  to 
similar  schools. 

Research  plans  also  include  investigations  of  some 
of  the  ways  in  which  guidance  and  counseling  may  affect  oin: 
students.  For  example,  we  will  attempt  to  investigate  the 
relationship  of  guidance  to  hl^  school  drop-out  rate. 
Research  will  also  be  conducted  on  the  relationship  of  gui¬ 
dance  to  helping  attuients  fozmulate  college  plans,  obtain 
sdiolar^ips,  or  choose  a  vocation. 

the  results  of  Project  Talent  are  expected  to  contri¬ 
bute  greatly  to  the  body  of  research  tnfozmatlon  guidance 
counselor's  use  in  helping  students.  The  counselors  first 
concern  is,  of  coxirse,  to  aid  the  student,  \islng  all 


possible  resources  at  his  disposal.  Among  the  tools  needed 
for  educational  and  vocational  guidance  are  nationally 
standardized  tests  of  aptitudes  and  abilities,  and  Informa¬ 
tion  on  personality,  Interests  and  backgroxmd  that  hai 
demonstrated  relevance  to  educational  and  vocational 
success.  Project  Talent  vill  provide  a  great  deal  of 
this  Information  throxi^  Its  research  results.  Although 
Project  Talent  tests  vill  not  be  u^d  commercially, 
findings  of  the  s€udy  should  contribute'^  the  develop- 
ment  of  better  methods  for  identifying  each  student  *s 


talents. 
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CHAPTBS  XI 

THE  MINDS  OP  AMERICAN  YOUTH 

Charles  MEurtln 

Left  tadEle  Charles  Martin  (naae  fictitious)  sat  astride 
a  chair  in  the  classroom,  his  huge  bulk  filling  it  eucd  over¬ 
flowing.  He  was  writing  a  five-minute  theme  for  Project 
Talent  on  the  topic  "What  High  School  Means  to  Me." 

This  is  what  he  wrote: 

"If  I  were  to  be  dishonest,  I  would  say  I 
obtained  much  from  high  school;  but  alas, 
to  i^y  dismay,  my  honesty  provides  that  I 
should  tell  the  truth.  It  meant  a  good 
tlmeJ" 

Charles  (age  l8)  is  the  son  of  a  small  businessman  in 
ccmifortable  ciifexmistanceB .  Both  of  his  peovnts  yere  hl£^ 
school  graduates.  He  leeuned  to  dance  at  twelve,  has  two 
dates  a  week,  and  expects  to  marry  at  nineteen.  He  es^cts 
to  go  to  college  and  study  eaglaeerlag.  He  has  had  six 
semesters  of  mathematics,  including  two  mwiths  of  calculus, 
and  has  made  straif^t  A*s  In  his  mathematics.  His  other 
grades  are  mostly  A*b.  However,  he  has  had  no  foreign  lan¬ 
guage.  Charles  is  interested  in  many  things.'  He  says  he 
would  like  very  much  to  be  a  Naval  officer,  chemical  engineer. 


Mrenatttleal  elaetnmloi  t«elmlelaA|  proftisional 

athlete^  eltetrlMl  nmXammr,  alalag  ngJjumtf  sports  \aqpixi» 
or  refOTMf  i>eha«loal  oagliutsr^  ■athwitlcloay  Air  Fore* 
Offloori  cellos*  professor/  psydbologlst/  mmOttr  of  tlM 
FresldooVs  ea.>laoir/  JiaAso>  S»  Soaster^  U.  8*  PoMpre*** 
■sjL.  Ee  expresses  a  strong  Uklag  for  Isasketball/  football/ 
traek/  algebra/  oxpleriBg/  and  baseball. 

For  bis  thane  on  Vievs  of  an  Ideal  Oeeupatlen”/ 
Charles  vretet 

"It  seons  natural  that  one  neuli  oraT* 
an  Ideal  eoeuiatlon.  To  be  perfectly  frank/ 

I  haT*n*t  sDihh  oonoeptlon  of  nhat  I  irlsh  to 
*nt«r.  Fezhaps  as  college  progresses  ny 
solution  vlll  shov  Itself." 

Charles  apparently  Is  getting  off  to  a  fortunate  stairt 
In  life.  He  appears  to  hare  eonslderable  talent/  and  plans 
to  go  on  to  college.  Hoverer/  a  nunber  of  questions  arise 
In  connection  with  hov  one  night  consider  Charles*  ease  fron 
the  point  of  rlev  of  a  counselor.  For  one  thing/  vhat  of 
the  lack  of  a  foreign  language!  Will  this  stand  In  the  nay 
of  his  adnlsslon  to  a  college  that  can  nake  nanlnun  derelop^ 
■ent  of  his  talents?  Will  he  end  up  later  in  life  regretting 
his  lack  pf  a  foreign  language? 

Are  Charles*  vozk  habits  uhat  they  should  be  to  continue 
to  aake  good  grades  at  a  really  tou^  engineering  school? 

Is  he  being  sufficiently  challenged  by  the  school  he  has  been 
attending? 

Charles  is  a  good  eanHeple  of  a  student  vltie  high  talents 
she  aakes  geed  grades  and  glans  to  go  to  ooUeg*  and  yet 
night  have  profited  by  right  sort  of  counseling  in  the 
earlier  high  eehool  grades. 
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Sophia  Martlnottl 

Sophia  (age  17>  name  fictitious)  vants  to  he  a  privata^ 
secretary;  she  doesn't  want  to  go  to  college.  For  her  theme 
she  wrote: 

"High  school  means  the  necessary  education 
in  order  to  get  the  joh  I  want  after  hi^ 
school.  If  I  quit  high  school  I  probably 
wouldn’t  be  able  to  be  a  private  secretary 
as  I  hope.,  to  .be .  JLf  I  got  a  job  wi+hout 
completing  high  school  I  wouldn't  get  as 
good  a  job  as  I  want  and  I  also  wouldn't 
get  enough  pay." 

For  her  other  theme  on  an  ideal  occupation,  she  wrote: 

"After  I  graduate  from  high  school,  I  would 
like  to  be  a  secreteuy  (if  possible,  a 
private  secretary).  I  would  like  to  earn  a- 
bout  $3 >500  to  $5,000  annually.  I  think  a 
secretary  earns  enough  money  to  live  comfort¬ 
ably  with  a  permanent  job  and  stable  income." 

Sophia  lives  in  a  six-room  apartment  with  her  mother, 
father,  and  five  brothers  and  sisters.  Both  parents  work 
and  are  union  members.  She  expects  to  marry  at  twenty-one 
or  twenty-two  years  of  age  and  e.xpests  to  have  four  children. 
She  expresses  a  high  degree  of  interest  in  such  occupations 
as  airline  hostess,  secretary,  typist,  housewife, 
and  also  such  activities  as  doing  clerical  work,  helping  the 
poor,  learning  about  diseases,  and  swimming. 

She  had  her  first  date  at  thirteen  or  fourteen,  and 
dates  about  once  a  week.  She  has  gone  steady  twice. 

She  reads  over  twenty-one  books  a  year,  but  mostly 
books  classified  as  advent ure|t  histories,  or  love  stories. 

She  studies  one  to  four  hours  per  week  and  is  taking  a  com¬ 
mercial  course.  She  has  had  three  or  four  semesters  of  math 
and  six  semesters  of  foreign  language  in  the  ccwercial  cur¬ 
riculum.  Her  grades  are  B's  or  better  except  in  science 
and  foreign  language,  where  they  are  C's.  She  says  most  of 
her  friends  don't  expect  to  go  to  college,  and  that  she 
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would.  DOt  borrow  money  for  college.  Sophia  vro1:«  two  well- 
written  theoee  Indicating  a  potential  for  profiting  by  col¬ 
lege  attendance.  Her  patterns  of  infonoatlon  and  school 
grades  indicate  also  that  die  night  profit  from  instruction 
at  an  apprcpridts^eollitgto: 

Many  of  those  qualified  for  college  but  not  planning  to 
attend  are  similar  to  the  case  of  Soj^la.  In  dealing  with  a 
case  of  this  sort>  the  counselor  needs  the;  help  of  accxirate 
scholastic  ability  measures  in  order  to  help  pxedict  how 
well  she  would  do  at  various  kinds  of  colleges.  Counseling 
is  also  very  Important  in  these  cases  at  the  time  the  basic 
choice  is  made  to  take  a  coinnercieQ.  rather  than  an  academic 
curriculum. 

Sophia  also  doesn't  believe  that  college  has  much  of 
value  to  offer  to  her.  What  could  the  counselor  and  the 
school  have  done  to  give  her  a  more  favorable  attitude  towards 
college?  What  will  Sophia  herself  think  in  future  yeeirs  of 
her  decision  not  to  go  to  college? 

Fred  Stone 

Fred  Stone  (name  fictitious)  wrote: 

”I  think  a  ideal  occupation  woxild  be  that 
of  a  Dentist  because  people  will  alway  have 
teeth  to  be  fists." 

And  this  one: 

"High  School  means  to  me  it  is  where 
you  get  your  flnl  egcation  be  for 
going  out  in  the  world." 

Here  is  how  Fred  describes  himself,  his  family  and  his 
life  plans: 

Fred  was  l6  years  old  when  he  wrote  these  themes.  He's 
about  5*10"  tall,  weighs  about  1^5  pounds,  and  is  in  the  Uth 
grade.  He  lives  with  his  mother,  father,  two  older  sisters. 
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and  one  younger  brother  In  a  house  vMcb.  has  11  or  12  rooms. 
They  are  buying  the  house,  ‘which  has  a  ^^ue  between  $10,000 
and  $15>000.  They  live  in  a  cosasiuhity  of  about  23,000  in  a 
western  state .  His  father  is  about  32  years  old,  a  semi¬ 
skilled  worker  for  a  rather  large  ccm^euiy.  He  is  not  a 
superviscr.  Hie  mother  is  10  yestrs  youriger  .  She  b.as  bees, 
a  nurse,  but  is  primarily  a  housewife  now.  Fred  cctjsidsrs 
his  family  to  be  ’’well-to-do" .  The  family  income  is  between 
$9,000  and  $12,000.. 

What  is  his  family  heme  like?  Fred  has  a  room  of  his 
own,  his  own  desk  and  type'writer .  The  family  has  most  of 
the  modem  conveniences— electric  dishwasher,  autcmatic 
washer  and  dryer,  refrigerator,  vacuum  cleaner,  food  freezer, 
telephone,  radio,  phonograph,  sterling  sil-ver,  pai.nt-ings, 
■wall-to-'wall  carpeting,  and  drapes.  They  :have  hi-fi,  recD.t'ds, 
and  quite  a  bit  of  sport-s  equipment.  They  have  many  hand 
and  power  tools. 

Although  they  have  bet^ween  100  and  250  books  in  their 
home,  the  main  reading  apparently  consists  of  magazines-- 
ladies’,  men's,  movie,  mechanical,  news,  business,  etc, 

The  f«UEl.ly  has  two  cars,  the  newest  of  which  is  a  ,193^ 
model. 

Frecl.’s  parents  are  both  native-born.  His  father  is 
active  in  church,  but  his  m.other  is  not.  They  both  d.o  some 
work  in  the  FPA.  His  mother  is  acti-ve  in  the  League  of 
Women  Voters  and  other  civic  organisations,  but  his  father 
takes  no  Interest  in  politics  and  does  not  belcKig  to  any 
ci-nc  groups.  Fred  doesn't  know  how  much  education  his 
folks  have. 

Fred  says  he  is  in  excellent  health.  He  had  the  usual 
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childhood  diseases,  but  has  only  been  out  of  school  a  day 
or  two  at  a  tine.  He  sleeps  8  hours  aLnig^t.  On  veekends 
he  stays  up  until  12.  Although  he  learned  to  drive  at  19 
(driver  training  school)  he  Isnlt  alloved  to  take  either 
of  the  family  cars. 

He  first  began  dating  at  13- -has  about  3  dates  a  veek 
novj  he  has  gone  steady  once. 

Fred  says  he  really  isn't  interested  in  school.  This, 
he  says,  is  why  his  attention  venders;. he  can't  concentrate; 
he  doesn't  keep  up  to  date  on  assignments .  In  fact,  he's 
behind  stost  of  the  time.  He  doesn't  feel  that  the  courses 
will  help  him  after  he  gets  out  of  school* 

When  he  gets  an  assignment,  he  isn't  always  sure  of 
of  vhAt  he  is  to  do.  He's  not  a  fast  reader  (he  pronounces 
words  to  himself),  but  he  does  understand  what  he  reads. 
\nien  he  turns  something  in,  most  of  the  time  his  teachers 
tell  him  that  it's  sloppy.  He's  careless  about  spelling 
and  English,  ^ich  pvills  his  grades  down.  Not  paying  at¬ 
tention  in  class  has  hurt  his  grades  most  of  the  time,  too. 
He  doesn't  consider  school  work  a  challenge. 

He  studies  on  an  average  of  seven  hours  a  week.  He 
reports  that  he  is  a  C  to  D  student.  His  school  record, 
themes,  and  very  poor  scores  ofi  all  the  information  tests 
agree  in  indicating  a  very  poor  prognosis  for  success  at 
college . 

Fred  has  been  active  in  clubs.  He  played  on  two  ath¬ 
letic  teams,  and  reports  he  was  captain  of  (»e.  He  learned 
to  dance  idien  he  van  13. 

Fred  likes  to  hunt  and  fish,  and  has  often  gone  in  for 
gardening,  sports,  and  repairing  cars.  In  addition,  he  goes 
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to  concerts,  plays,  museums,  etc. 

He  helps  cut  around  the  house  about  6  hours  a  veek, 
and  vorks  21  hours  a  week  to  earn  money.  If  he  needs  more 
spending  money,  he  gets  it  from  his  family. 

In  the  last  year,  he  has  reeid  fever  than  ^  hooka  out¬ 
side  of  school  requirements,  and  these  axe  of  the  vestem 
adventure,  science  fiction,  comic  book  types. 

Fred  made  up  his  mind  in  the  7th  grade  that  he  wanted 
to  be  an  engineer.  He  has  had  many  discussions  with  his 
teachers  and  counselors  regarding  college.  Perhaps  as  a 
result,  he  has  decided  that  he  will  likely  to  go  to  a  busi¬ 
ness  school- -part-time — or  a  junior  college.  His  plans  are 
indefinite — he  may  go,- but  expects  it  to  last  less  than  four 
years.  His  parents  want  him  to  have  a  college  degree,  but 
he  says  he  can  expect  no  financial  help  from  them.  Rather, 
he  will  have  to  depend  on  other  sources --working,  scholar¬ 
ships,  etc.  He  would  not  consider  taking  out  a  loan  to  get 
through  school. 

Despite  his  lowered  level  of  aspiration,,  he  expects  to 
be  earning  $25,000  twenty  years  after  high  school  graduation, 
and  wouldn’t  be  satisfied  with  less. 

He  expects  to  go  into  service  by  getting  an  ROTO  com¬ 
mission.  He  dislikes  the  thought  of  a  permanent  military 
career,  however,  but  might  consider  it  if  the  salary  were 
better . 

Fred  considers  job  factors  in  the  following  order  of 
iniportance: 

Security 

Freedom  of  decision 


Good  income 
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Friendly  assoolatee 
ProBustlon 

loportance  of  vork 

Hovever>  to  improve  himself  from  one  Job  to  another, 
he  puts  the  factors  In  this  order: 

Qood  Income 
Promotion 
Better  Supervisor 
Better  associates 
Importance  of  vork 

i 

Security 

He  hopes  and  e:qpects  to  be  *'vell- to-do" ,  and  have  one 
child. 

Fred  presents  a  tou|^  problem  for  a  comselor.  Al¬ 
though  he  has  alvays  vanted  to  be  eui  engineer,  he  appears 
to  lack  the  qualities  \dilch  will  move  him  tovaord  that  goal. 

If  he  eouldv  even^et  into  college  vith  his  grades,  his 
habits,  his  lack  of  interest  in  school,  his  low  test  scores, 
and  his  past  history  indicate  that  he  is  not  a  good  bet  to 
succeed.  Even  after  dropping  beu:k  to  a  more  realistic 
goal — business  school  or  Junior  college— he  remedns  uncer¬ 
tain  and  indefinite  about  his  plans . Maybe  he'll  go.... 

but  he  expects  it  to  be  for  less  than  four  years. 

Fred  may  be  typlccLl  of  many  students  his  age  vho  expect 
to  succeed  almost  by  a  magical  process,  vlthout  knowing  what 
it  really  takes  to  becoaie  a  $25,000-a-year  person.  His 
co'inselor  shovCd  begin  now  to  reorient  his  goals  to  a  siore 
realistic  level. 

Perhaps  Fred  has  subconsciously  done  this  to  some  degree 


■vdien  he  says  that: 
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School  means  to.  me  it  is  trtiere  you 
get  your  finl  egcation  he  for  going  out 
in  the  world." 

If  Fred's  test  scores  show  up  some  specific  aptitudes 
outside  of  the  academic  area>  he  might  still  be  able  to  be 
guided  into  a  useful  and  iiqortant  occupational  niche.  Right 
now  his  potential  in  life  does  not  look  encouraging  without 
proper  guidance. 

The  two  themes  written  by  each  student  reveal  knowledge  of 
effective  expression,  punctuation,  spelling,  and  English  usage, 
but  also  seem  to  reveal  in  mest  cases  something  about  basic 
attitudes,  values,  and  other  Important  insists  regarding  the 
student's  thinking  and  his  basic  personality  and  temperament. 

Initially,  it  will  not  be  possible  to  score  both  themes  for 
all  UV),000  students,  but  it  is  planned  to  score  a  small  sample 
of  them  to  provide  a  base  line  for  comparison.  Later,  during 
the  follow-up  studies,  it  is  planned  to  study  the  themes  of 
persons  tdio  end  up  In  groups  or  categories  of  specied  interest, 
such  as  statesmen,  scientists,  naval  officers,  and  the  like,  or 
also  groups  who  are  failures  in  life  in  spite  of  having  many  ' 
talents. 

Experience  with  the  themes  in  a  pilot  study  indicates  that 
it  should  be  possible  to  derive  from  these  themes  measures  of 
altruism,  scholeu'shlp,  basic  value  systems,  and  the  self-concept. 
This  may  result  in  some  contribution  to  the  basic  arts  of  per¬ 
sonality,  attitude,  and  values  measurement.  It  should  also 
result  in  substantial  new  insists  into  the  structvure  of  motiva¬ 
tion,  for  specific  careers.  Including  military  careers. 

Inltied  anfidyses  of  the  themes  should  determine  what 
kinds  of  scores  can  be  obtained  from  them.  The  scores 
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derived  from  the  themes  vould  then  he-  related  to  all  of  the 
other  meaexires  available  on  the  sane  laMvldual  In  oxder 
to  help  define  vhat  the  new  scores  mean  In  terms  of  con¬ 
sistency  and  overlap  with  other  known  measures. 

!fhe  first  step  In  the  analysis  of  the  Talent  results 
will  be  a  complete  analysis  of  a  carefully  drawn  suh-sanqple 
of  all  the  students  who  took  the  Battery.  This  sub-sample 
will  be  used  to  make  a  thematic  analysis  to  tabulate  the 
frequency  of  occiirrence  of  specific  theme  topics.  In 
this  thematic  analysis  a  '*theme  topic**  Is  defined  as  being 
an  Identifiable  basic  attitude  value  or  the  like,  such  as 
altruism,  social  activities,  learning  something,  making  mon¬ 
ey,  military  service,  or  the  like.  After  this  has  been  done, 
a  United  number  of  the  more  common  "theme  topics"  will  be 
integrated  Into  a  scoring  system. 

While  various  scoHng  systems  should  be  experimented 

with.  It  Is  believed,  on  the  basis  of  pilot  studies,  that 

the  most  promising  approach  is  to  have  trained  readers  read 

the  theme,  make  a  number  of  ratings,  and  at  the  same  time 

punch  these  ratings  Into  a  card.  One  score  mlcd^t  be  obtained 

by  rating  the  theme'  bn  a  9'~P0int  scsde  In  terms  of  adequacy 

of  writing.  The  other  ratings  vould  be  mostly  on  a  presence- 

absence  ’basis  idxere  the  rating  indicates  the  mention  of  a 

given  predefined  topic.  These  readings  and  ratings  Would 

be  obtained  independently  and  cheeks  vould  be  made  on  the 

e<m8lst«Ei(^  of  acorliig.  After  the  preliminary  set  of 

scores  had  been  derivmA.  from  the  thames,  thmy  will  be  sub¬ 
jected  to  statiatlcal  analysla  to  determine  their  Inter- 
relatlpni^lps  as  well  aa  their  relationships  with  the  other 
measui'es  available  on  the  same  subjects. 
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QJhe  reBearch  on  the  themsB  should  produce  a  valuable 
new  approach  to  the  scoring  and  quantitative  analysis  of 
saaples  of  vrltlsg  for  both  quality  of  "writing  and  fpr  aajy 
neasures  of  value  systems,  attitudes^  self»eonccptB  isuid 
teisperaaents*  She  final  outoome  should  be  a  generalised 
systam  appllcahle  over  a  wide  range  of  topics  and  e«itent 
of  eoqposltloas* 

While  the  final  scoring  system  for  the  essays  has  not 
yet  beon  woxtoid  out/  It  Is  believed  that  the  examlnatlen  of 
a  few  ssi^ples  of  theso  can  Illustrate  aone  of  the  different 
types  of  values  which  seem  to  emerge* 

Job  Training 


Kaay  studimts  see  education  essentially  as  specific  Job 
training,  fhls  Is  true  both  at  the  college  and  the  high 
school  terminal  level*  Seme  samples  of  thesa  are  given 
below: 

Olrl  aged  1^.  (Occupation) 

!'I  would  llhe  to  go  Into  the  field  of 
costume  design  after  a  few  years  or  so  of 
college.  Before  I  enter  college  (if  I 
decide  to  go)  I  would  like  to  go  to  busi¬ 
ness  school  for  a  few  months.  Bo  In  case 
I  den*t  get  a  Job  In  the  field  of  costume 
design  right  away,  I  will  be  equipped  for 
aeoretarlal  work." 

Boy  aged  If*  (High  School) 

"In  everyday  life  I  think  that  school  doesn*t 
mean  much  to  me.  I  think  that  I  am  going 
because  my  mother  and  father  are  keeping  me 
there.  But  when  you  get  down  to  brass  tacks, 
schec:!  Is  the  basis  of  iqr  entire  future  as 
well  as  every  ether  staid«nt*B  in  my  dase. 

Wltheut  going  to  high  eehool.  It  would  be 
vwgr  difficult  to  get  a  good  Job  which  would 
satisfy  you.  So  I  think  thnt  every  student 
should  en  going  to  sdMwl  until  he 
graduates  and  then  he  would  have  a  better 
^Bncd  to  get  a  Job.” 
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SooUl  ggrsloe 

On  tlM  otiMT  hand;  a  suaaibtr  of  s'budan'bB  hare  vaxy 

•troagljr  e3e]pttaa«d  dsnlrvs  to  te  of  social  ssrvloo  to  othera. 

SxajiplM  of  thia  are!  given  balovt 

Girl  aged  l8f  (OcenpatloiL) 

BM  teaching  la  the  alBaantary  school 
Irvsl  Is  the  ideal  professloaa*  It  covein 
aa  excellent  flell  aal  reqoirss  dedication* 

Oils  Ideal  occupation  aliould  and  does  hold 
SQr  interest.  What  could,  be  more  revarding 
thaa  iw)],di.iig  and  shaping  the  Minds  of  to*» 
soxrov^s  eltizsiu.  Mlttieiy  cannot  meastire 
the  satisfSstion  gained  frcei  this  profssslon." 

Boy  aged  19.  (0ceu3pation) 

"Bie  Ideal  piece  ef  vox^  I  voiuld  enjoy 
having  would  be  BOosethlmg  in  line  of  social 
working  among  delinquen'ba  in  lew  fork  or 
saybe  a  job  as  an  artis't.  Shese  jobs  are 
both  creative  jobs  ond  X  think  more  suited 
for  this  type  of  work;  for  it  gives  me  a 
Chance  to  es^ress  ny  self  and  mayba  helping 
a  Jeb  or  two  Ilka  n^sslf 

Moii^ 

Of  courssj  a  common  thesie  in  many  essays  Is  money  or 

material  goods  or  material  success;  expressed  In  a  number 

of  ways.  Exsaqples  are  given  belov: 

Boy  aged  17.  (Occupation) 

"I  believe  that  the  Idsed  occupation  la  a 
lavyer.  A  lawyer  doesn't  have  to  get  paid 
by  the  week  or  month;  but  by  the  case .  Some 
causes  yield  him  Boxre  than  the  average 
persons  total  wages  for  a  year.  But  of 
course  there  are  all  different  types  of 
lavyers;  such  eia  arlslnal;  BaainessMf'' 

Boy  aged  17*  (Occupation) 

"a  sULUonalre” 

Security 

SoBse  stodanta  are  very  ssecurlty  conseloas  and  this  seems 
to  loom  large  In  their  thinking  and  planning.  Examples  are 
given  below: 
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I 

I 


Girl  aged  1^.  School) 

"la  Mjf  alad  hlji^  school  nsaiis  a  3qio«i04^  of 
thlags  I  eaa  carry  vltih  no  lal^  the  years. 

It  sots  forth  a  lot  of  floaorlos  I  eaa  cherish 
sad  yass  dona  to  my  ehlldrca.  Bat  Mostly 
hif^  sekool  Msaas  socurity  for  the  future." 

Boy  Srgod  l6  (oscuipatioa) 

"I  vsuld  like  a  good  oceufatloa  vlth 
soourity  and  rocn  for  adveaceoseat.  I 
vofuU.  Ukt  a  Jot  with  a  salary  of  $1^^000 
or  More  a  year  aad  good  -worklag  coadltioas 
aad  alee  veoyle  to  vexk  with." 


LMjmliuc 

I  W  I  f  i  Xil 

SoBM  studeats  seoa  to  give  oonslderehle  laportaaoe  to 

learning  as  a  gfsal  in  Itself.  Scsie  give  Much  la^ortaace  to 

aehleveasat/  the  attaiaaeat  of  fajne^  becoming  successful. 

Girl  aged  1^  (Occupation) 

"Vs  M  aa  Ideal  occupation  Is  teaching. 

Vsaohing  gives  you  a  satlsfaetlon  la  know^ 
lag  that  you  are  helping  others  to  learn. 

Vtaabiag  also  broadens  your  ovn  personal 
knovledge.  I  want  to  be  a  teacher  beeauae 
I  think  t^t  teachers  are  aaeng  the  Most 
called  for  professions  of  this  day.  Some 
studeats  are  not  gaining  the  kz;evledge  they 
should  because  the  teaioherB  are  not  teaching  . 
preperly.  I  plan  to  teach  to  the  beat  of 
my  ability  and  help  others  all  I  can.  This 
Is  my  Idea  of  an  Ideal  occupation." 

Girl  aged  17 .  (High  School) 

"I  have  aieeys  enjoyed  school  and  done  my 
best  to  got  good  marks.  High  school  is  the 
last  lap  la  education  before  college  and 
extroMely  in^rtant.  High  school  Is  the 
educational  foundation  of  our  education  to 
OCHS.  It  Is  a  determining  factor  on  -vdiat 
our  future  lives  shall  be  like.  High 
school  also  hol^  to  dovelc^  000*8  person¬ 
ality  aad  ability  to  got  alsag  with  ethers. 

!Ihls  toe  Is  part  of  (»ao*s  sduoatlon." 

Social  Actlvltjr 

Other  students  stress  social  aotlvlly. 


ag«4.  17*  (Hlfpx  8clio«l} 

"Hiitti  BcHml  is  a  wma»  to  |art|Bar«  i^aelf 
for  Mlligi  ttat  atOy  $4MlfljrSUr  But  laelalljr. 
AllAuraidi  t  faqpBot  a^iwol  to  ytoyan 
M  a«  aato  at  f«ar  to»  xlgax«  of 

oolJLBSB  olaatoOf  1  also  mfWt  U  to  impare 
iio  toOlAllar*  A  tiam  alaUl  i»  Tivjr  iooA^  tiut 
ovut  a  gtoittft  aaar  toMMaMi  a  Mtfvtoui  mook." 


Olvl  agtdi  37*  (Oeoayaklodi) 

*i  vmiM  lifet  to  to  1»  a  ipiofiaalto  vtoro 
I  tottlA  aoit  all  krfto  of  Btoglo*  Mootljr 
1  otot  to  to  oathoy  (noHUTwim  of 
]ffoflaalOttal«  I  ooalA  Tioar  otoli  Uto  to 
to  a  eorUflod  j^llo  aocMwatoot  aoorotor^f 
or  offloo  olofk*" 

It  la  to|o4  lihat  toe  tofotoatlaai  el^tolaaklo  trem  toe 
iaaaya  vlll  tolf  sanlonoixt  too  Ob^otoiro  toal  aadL 
qooatooaoalto  lafO»ati<»i  la  glTlag  a  wtre  omqdeto  deaerlp-^ 
tioa  of  toe  aroato  la  toe  atodsr* 
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CHJ^FIXR  ni 

KBKD  HUVE  m  ISARRED  FROM  PROJECT  TMERTt 

First  and  foraoDst,  we  have  learned  that  a  national 
cen8\i8  of  the  l|)tl tildes  and  achlevonents  of  Anerlcan  youth 
Is  feasible  and  can  be  done.  The  data-gatherlng  phase  has 
been  con^ileted  successfully  with  excellent  cooperation  from 
all  the  Individuals  Involved.  .Preliminary  Inspection  and 
analysis  of  the  data  indicate  that  the  students  cooperated 
and  were  well  motivated,  and  the  teachers  In  the  schools  did 
a  good  Job  of  giving  the  tests  and  collecting  the  44ta. 

.While  this  in  Itself  may  not  appear  very  difficult  to 
suscon^llsh,  consider  that  neeurly  one  and  one-quarter  million 
Individuals  had  to  cooperate  to  mahe  the  study  possible. 
.Approximately  ^000  school  board  meodt>er8  and  750  superinten¬ 
dents  had  to  agree  to  cooperate  and  to  devote  two  full  days 
of  their  Instructional  program  to  the  collection  of  data  for 
the  Project.  Approximately  750,000  par«its  and  guardians 
and  aiproxlmately  ^X},000  students  were  Involved.  Approxi¬ 
mately  liiOO  principals  and  headmasters,  1500  counselors, 
and  l8,000  teachers  were  responsible  for  the  actual  giving 
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of  the  tests  and  collection  of  dsta«  Each  school  also 
filled  out  a  ^'page  questionnaire. 

. In  most  cases  the  students  vere  tested  by  their 
teeushers  In  saall  groi^  of  25  or  so.  Ihe  90  Eeglonal 
Coordinators  took  the  Project  to  the  schools  and  were 
responsible  for.  all  the  field  work*  ..^proxlsately  60 
advisers  and  consultants  supported  the  staff  of  seven 
professional  resecu^sh  personnel  vbo  were  responsible  fdr 
carrying  out  the  Project.  Probably  ho  research  project  in 
history  has  Involved  so  many  Individuals  so  closely,  and 
certainly  no  large  research  project  of  this  magnitude  has 
been  as  thoiwighly  decentredlzed.  .  Mon-cooperation  by  any 
link  In  this  chain  .would  have  made  it  inqposslble  to  ocmi- 
plete  the  Project. 

In  particular,  the  schools  and  teachers  really  outdid 
themselves  In  carrying  out  such  a  massive  testing  program. 
Many  schools  which  had  never  before  done  very  much  testing 
carried  out  the  program  with  enthusjasm.  .Under  the  general 
guidance  of  the  Regional  Coordinators,  the  teeushers  did  a 
very  satisfactory  Job  of  giving  the  tests  and  collecting 
data. 

Ihe  enthusleustlc  response  and  cooperation  of  this 
large  group  Indicated  that,  collectively,  they  have  great 
faith  In  the  vitality  and  edaptlveness  of  the  American 
systems  of  education.  -While  these  hundreds  of  thousands  of 
Individuals  differ  In  many  laportcmt  ways  In  their  approach 
to  life  and  education,  they  united  In  support  of  Project 
Talent  in  the  belief  that  It  is-good  to  learn  more  about  our 
youth  and  our  schools  and  that  ihils  knowledge  will  help  us 
to  adapt  to  the  challenges  of  om'  modem  world. 
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Kov  that  the  data  have  been  ooUected^  id^t  will  we  \ 

learn  about  our  youthT  From  the  preliminary  analysis  of 
the  data  during  the  first  year  or  two^  we  will  learn  -a,  . 
great  deed,  about  the  basic  talents,  cushlevements,  alms, 
perc^tlons,  aspirations,  plans,  and  values  of  American 
youth. 

Ife  will  laum  what  youth  wants  to  be.  ^  win  know 
what  proportion  of  boys  and  girls  of  various  ages  in  differ¬ 
ent  grades  would  like  to  become  cheadsts,  auto  mechanics, 
musicians,  research  scientists,  actors ,  og^aettMaes ,  pro¬ 
fessional  athletes,  doctors,  lawyers,  politicians,  high 
school  teachers,  college  professors,  religious  workers. 
President  of  the  lAilted  States,  and  so  on. 

We  will  learn  idist  youth  wants  to  do.  •  We  will  leani 
trtiat  proportion  of  the  various  categorieg  of  youth  like  such 
activities  as  reading,  fishing,  basketball,  saving  moi^, 
buying  stocks,  studying  algebra,  becoming  a  millionaire,, 
hunting,  reading  poetry,-  piecing  bcuseball,  caaQalgnlng  for 
political  Office,  owning  their  own  business,  helping  their 
peuants,  visiting  airt  galleries,  playing  chess,  watching 
television,  studying  foreign  leuiguages,  teaching  children, 
reading  llteratvure,  going  to  school,  military  drilling,  and 
doing  many  other  similar  things. 

■We  will  iMim  what  youth  knows.  We  will  learn  idiat 
young  people  know  about  science,  guns,  fishing,  military 
activltlea,  architecture,  medicine,  animals,  gsmes,  languages, 
business,  foods,  boats,  photc^pmqphy,  theater,  geography,  art, 
swlJBKLng,  literature,  the  Bible,  music,  social  studies, 
ifazmlng,  mathematics,  electronics,  mechanics,  etc. 


We  vlll  leam  youth  will  he  able  to  do.  Pron:  the 
aptitude  and  aohleveaent  test  scores  we  will  be  able  to 

estimate  the  capabill'^  of  our  youth  for  such  Is^ortant  4 

activities  as  attending  different  Kinds  of  colleges, .  and 
for  absorbing  training  In  many  in^ortant  activities  la  mill-  ^ 

tary  and  civilian  life  such  as  electronics,  mechanics,  cleri¬ 
cal  and  secretarleLl  work,  or  learning  foreign  lang;uages. 

We  will  sketch  out  the  life  history  of.  American  youth. 

.  Itor  various  categories  of  our  youth  we  will  have  information 
on  the  percent  engaging  In  numerous  hobbles  and  activities. 

We  will  leam  about  their  work  experiences — their  part-time 
work  and  summer  Jobs  and  the  n\miber  of  hours  they  spend  per 
week  doing  chores  at  home.  In  the  very  ia^rtant  area  of 
dating,  we  will  leam  how  old  they  were  idxen  they  had  their 
first  date,  how  many  times  they  have  gone  steady,  how  often 
they  have  dates,  and  also  at  vb&t  age  they  learned  to  dance.  ^ 

Ihls  Information  shQttld  be  extremely  valuable  to  aWndy  as  a 
"factor  Influencing' sbudy  habits,  staying  In  school^, gQlSg  to 
college,  oaklng  grades,  and  the  like.  We  will  leeum  much 
about  the  reading  and  study  habits  of  young  people  in  re.- 
latlon  to  the  grades  they  make  euid  the  way  they  carry  for¬ 
ward  their  ediicatlon.  We  will  leam  about  their  marriage 
plans.  This  Is  very  In^rtant  In  regard  to  idiether  they  go 
to  college.  We  will  leam  much  about  the  driving  jand  auto¬ 
mobile  activities  of  youth.  It  Is  well-known  from  prevlovis 
studies  that  these  are  very  important  In  relation  to  study-  < 

Ing  and  making  gpod  grades.  We  will  leam  a  great  deal 

about  the  future  plans  of  American  youth  in  relation  to  , 

college,  military  careers,  planned  occupations,  professions, 


etc. 
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From  all  of  this  will  emerge  comprehensive  pictures  of 
the  various  types  of  American  youth  in  relation  to  their 
schools  and  homes.  This  information  should  be  of  great 
Interest  and  value  to  all  those  concerned  with  educating 
our  youth  and  dealing  with  their  problems. 

Studying  Effects  of  Teaching 

There  is  much  discussion  these  days  about  changes  in 
Anerlceui  education.  Proposals  have  been  made  to  get  rid  of 
all  the  small  schools^  make  the  classes  smaller,  pay  the 
teachers  more,  use  different  Instxiictlonal  methods,  revise 
the  curriculum,  and  many  others.  All  of  these  cost  money, 
and  probably  most  of  them  wovild  have  a  favorable  effect  on 
the  schools.  However,  very  little  is  known  about  what  the 
relationship  Is  between  class  size  and  how  much  the  students 
learnj  or  about  the  proportion  going  to  college  or  the  like, 
with  other  things  held  consteuit,  such  as  the  kind  of  ccsnmunity 
the  school  serves.  Likewise,  we  have  little  information  on 
the  effects  of  any  sclwol  practice  on  the  ultimate  goeJ.  to¬ 
ward  which  the  schools  are  working.  In  particular,  very 
little  is  known  about  how  different  ways  of  educating  the 
gifted  and  those  with  special  talents  affect  the  extent  to 
which  they  obtain  maximum  utilization  and  fulfillment  of 
their  teilents. 

To  learn  the  answers  to  such  questions,  it  is  necessary 
to  study  a  very  large  number  of  students  and  their  schools 
and  to  do  a  thorough  nation-wide  follow-up  of  the  students  to 
see  to  idmit  extent  their  later  behavior  coincides  with  the 
planned  desirable  outcome  goals  of  the  school.  Within  the 
first  year  follow.4iix  of  Project  Talent  we  will  begin  studying 
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4.  %iy  dA  some  able  studeats  dlallbe  studying,  and. 
how  can  the  schools  best  encourage  them  to  study  moreT 

.Wien  and  hov  do  students  make;ii^rtant  decisions 

-  ..  ./■ 

regarding,  ^eir  educational  and  vocational  careers  t  Hov 
nay  the  teachers,  counselors,  and  parents  best  assist  youth 
in  making  these  decisions  more  wisely? 

Future  Publications 

As  the  data  from  the  testing  and  follow«up  studies  are 
analyzed  they  will  be  reported,  in  later  voliimes  Of  this  same 
series.  Volume  U.  Bd.ueational  and  Quidance  Prograa»  in  the 
American  High  School .  and  Volume  I)CI,  The  American  Hirii 
School  Student .  will  be  published  in  about  twelve  months. 
Volume  Vf,  The  American  Hirih  School  Graduate,  should  appeccr 
about  a  year  later. 

The  general  planned  content  for  Volumes  II  and  .III  is 
given  below: 

Volume  II 

Educational  and  Guidance  Programs  in  the  American  Sigh  School 

A.  Introduction:  Brief  over-all  view  of  Project  Talent 

B.  Collecting  the  information 

1.  The  tests— brief  description 

2.  . The  questionnaires 

a.  How  developed 

b.  Hov  administered 

C.  .Life  history  of  the  American  school 

1.  T^pes  of  secondary  schools 

2.  The  community  served  by  the  school 

3.  Sxpendltures 

I  4.  The  Principal  | 

i  ! 

I  5*  The  Faculty  j 
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6.  Class  size 

7.  AdBlsslon^  asslgnnent,  promotion^  and  grading 
policies 

8.  Homework 

9.  Ibe  school  building 

10.  The  library 

11.  .  Double  shifts 

12.  Summer  school 

13.  Classes  for  special  groups 

14.  Treatment  of  the  gifted. 

15.  Jtorelgn  language  Instruction 

16.  I^llglous  education 

17.  .Absenteeism 

18.  Student  turn-over 

19.  Brop-out  rate 

20.  College  attendance  rate 

21.  .Extra-f curricular  activities 

22.  Courses  offered 

0.  The  guidance  programs  of  the^  American  school 

1.  Humber  of  persons  assigned  full-time 

2.  .facilities  for  counseling 

3.  facilities  for  referral 
,  k.  Problems  treated  by  counseling 

Counseling  procedures 

6.  Conferences  with  parents 

7.  fihst  counselors  do 

8.  Policy  on  r^;)ortlng  test  results  to  students 

9.  .Recent  changes  In  program 

10.  Flans  for  expansion  of  covinsellng 

11.  Flans  for  expansion  of  testli:^ 

I 

i 
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12>  .1319  use  of  tests 

a.  . Hhat  kind 

b.  .  Eov  used 

13.  Vocation  Infoxmtlon  proepsimB 
.l!be  counselors 

a.  Sex,  a^e^  salaxy 

b.  Percent  of  time  In  counseling 

c.  .Sutles  assigned 

d.  Distribution  of  time 
e«  Training  and  experience 
f.  .i^proach  to  counseling 

E.  Hhe  results  of  educational  and  guidance  practices 

1.  Hov  to  determine  results  of  school  practices  as 
they  affect  life  outcomes 

2.  Effects  on  drop-out  rate 

3*  .Effects  on  college  attendance 

4.  Effects  on  occupational  plans 

5.  Effects  on  life  adjustment 

6.  Effects  on  amount  learned 

7.  Effects  on  attitude  toward  lesuTnlng 

8.  Effects  on  reading  skill 
9-  Effects  on  writing  skill 

10.  .Effects  on  spelling  ability 

11.  .Effects  on  motivation  for  science  eaupeers 

12.  Effects  on  motivation  for  mathematics  ceureers 

13.  Effects  on  economic  attitudes 

14.  Effects  on  military  carete  plans 

F.  Plans  for  farther  volumes 


Volume  UI 
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A.  Introduction 

The  teBt8>-vhat  they  measure 

1.  Description  of  tests 

2.  MeanSj  standard  deviations^  and  r's— treated 
non-technlcally 

3«  Relationships  to  other  oogmon  tests 

C.  The  talents  of  American  youth 

1.  Test  scores  of  bOj^iiand  £lrls 

2.  Students  with  hl£^  or  low  grades  in  key  subjects 

3>  Students  grouped  by  grade,  age,  father's  occu> 
patlon,  student's  planned  occupation 

14- .  Coimtry  vs,  city,  regional  differences 

Large  vs.  smeQl  schools 

6.  Plana  for  college 

7.  Plana  for  military  service 

8.  Drop-out  Intentions 

9.  Marriage  plans 

10.  Science  csireer  plans 

D.  The  life  history  of  American  youth 

1.  .Distributions  by  grede  and  sex  for  Items  on: 

a.  Hobbles 

b .  . Clubs 

c.  Sports 

d.  .Work 

e.  Spending  money  and  allowances 

f.  Dating,  dancing,  going  steady 

g.  Reading  habits 

h.  Study  habits 

1.  PiQplls'  prior  school  history 

(1)  Changing  schools 

(2)  Absenteeism 
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(3)  ProBotlon 

(4)  Courses  taJcen 

(5)  Grades  received 

(6)  Counseling  received 

J .  Family  and  hone 

(1)  Father— age,  occupation,  education, 
military  service, .  •shether  bom  In  U,3«, 
lauiguage  spoken,  organizations  belonged 
to.  Income 

(2)  Mother— age,  education,  working  status. 
Income 

(3)  Brothers  and  sisters— twins,  number  of 
children,  birth  order,  education 

(4)  Housing— rent  paid  or  value  of  home, 
number  of  rooms  In  home,  nvmber  living 
In  hone,  books  In  home,  tools,  magazines, 
appliances 

(5)  Where  family  lived  prevlovisly 

k.  Age  expect  to  marry,  nianber  of  children 
expected 

l.  Health  status --helgdit  and  weight,  vision, 
hearing  hemdlcaps,  disease  history,  amount  of 
sleep 

m.  Special  awards  received 

n.  Drlvlng--age  learned  to  drive,  car  ownership, 
driver  training  received  at  school 

o.  Plans 

(1)  Continue  higdi  school 

(2)  Go  to  college— what  kind,  when,  how 
many  colleges  applied  to,  how  far  from 
home,  where  ejqpect  to  live,  taking 
national  Merit  ScholEUrship  Tests,  reasons 
for  college  attendance,  attitude  toward 
college,  college  plans  of  friends,  attl> 
tude  of  parents  toward  college 

(3)  NLlltazy  service— lifetime  career  in¬ 
tentions,  choice  of  service,  reasons 
for  plans 

(4)  Occupations— desired  occupation,  expec¬ 
ted:’ occupation,  firmness  of  choice, 
when  decision  made,  who  helped  make 
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decision,  reasons  for  choice 

(5)  Financial  plans^-aalaiy  expected,  sayings 
account,  stocks  and  bonds,  real  estate, 
life  insurance,  install  tent  buying, 
reasons  for  saying,  how  much  wealth 
expected 

Cost  of  college 

(1) .  Willingness  to  borrow  under  various 

conditions 

(2)  Amount  of  money  needed 

X3)  Sources  of  support  expected 
E.  What  American  youth  knows 


1.  What  school  students  know  about  the  following 
(distributions  of  sub-scores  or  typical  infonnatlon 
items  in  -each,  area) : 


Bible 

Words 

Books 

Music 

History 

Mathanstlcs 


Science 

Space 

Electronics 
Mechanics 
Farming 
Home  Economics 


Sports 

Quns 

Business 

Geography 

Floods 

Animals 


F.  How  American  youth  reads 

1. 


2. 

3. 

1*-. 

5. 


G.  Ihe 

1. 

2. 

3. 

k. 

5. 

6. 


The  Domain  Test  concept  (saopling  a  defined  domain 
or  area  of  skills) 

How  many  words  hl^  sciiool  students  can  \ise 
.How  well  they  cem  spell 
How  well  they  can  read 

.  The  correlates  of  reading  skill — father ' s  occupation, 
mother's  education,  hlfd^  school  grades,  college 
plans,  the  charsusterlstics  of  good  vs.  poor  readers 

Interests  and  activities  of  American  youth 


Science 
Oonputatlon 
Mechanical — technics^ 
Skilled  trades 
Idtereuy—llngulstic 
Social  service 


7.  .Public  service 

8.  Musician 

9.  Artistic 

10.  BusIimss  Nuiageaent 

11.  Sales 

12.  Office  work 


If 
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13.  .I«bor  15*  Bunting  sind  flsli±ns 

14.  Amu  and  ranch  I6.  Spoirts 

fi.  personal  q.uallties  of  American  youth 

Culture 
Iieaderahlp 
Self-confidence 
Maturity  of  pereoria3.±tiy 
Conventlonalltiy 
Hxeoretlcetll  ty 
13*  Oroup-cen’teredness 
I.  FoUcvlng  the  Uvea  of  American  youth 

1.  Pollov-up  plans 

2.  -What  we  expect  to  leam  about: 

a.  College  attendance  and  success 

h.  High  school  drop-out 

c.  Bitry  Into  occupations 

d.  Occupational  satisfaction  and  success 

e.  Military  service 

f.  Marriage,  divorce,  children 

g.  Social  behavior  problems 

h.  Psychiatric  problems 

i .  Creativity 

j.  Migration  patterns  of  students  with  cLiJ^dfferent 
talents 


li  Sociability 

2.  Social  sensitivity  8. 

3*  Impulsiveness  9* 

k.  Vigor  10. 

Calmness  11. 

6.  Tidiness  12. 


0( 
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Voliane  lYr  THae  Aaerlcan  Pfjh  SfthoQl  OraduKte 

Plans  are  lass  daflnlte  for  the  exact  dataiied  eoDtent 
of  Volupe  17 f  tut  in  general^,  this  id.!!  report  the  xesult  of 
the-  first  of  the  one  yeeu*  follos>up  studlea*  Tbe  aenlars 
Mjao  wre  tested  in  i960,  vill  he  folioeed  \3^  In  196I.  !I9ae 
taaterial  that  ve  collect  from  them  villi  then  he  related  to 
all  of  the  material  collected  on  the  students  at  tte  time 
they  were  tested  in  X96O  and  also  to  the  information  collec¬ 
ted  about  the  schools  at  that  time.  A  large  amount  of  infor¬ 
mation  should  he  reported  in  thia  voluma  recgardlng  the  xe* 

lationehip  of  .the  nrigisally-gathered  data  to  such  fo^ow- 
vip  measures  as  school  attendance  and  succeaa^  the  kind  of 

course  of  study  entered,  high  school  dro]^out,  .entry  Into 

! 

occupations,  occupational  satisfaction  and  success,  military 
aerylce,  marriage^  social  behavior  prohlems,  psychiatric 
prohloos,  creativity,  and  migration  patterns  of  students 
with  different  talents. 

Prom  all  of  this  will  emerge  coiBprehensive  pictures 
of  the  various  .types  of  American  youth  in  relation  to  their 
Schools  and  homes  and  their  plans  and  Ssplrstlons*  TBds 
information  Should  be  of  eepB.t  interest  and  value  to  all 
those  concerned  vlth  educating  our  youth  and  dealing  vltb. 
their  prohlems. 


